10/21/2024 02:01:19.937 7f4d45cc3d88 [contrail-analytics-api] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 10/21/2024 02:01:19.938 7f4d45cc3d88 [contrail-analytics-api] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 10/21/2024 02:01:19.938 7f4d45cc3d88 [contrail-analytics-api] [INFO]: SANDESH: Flow Logging: [None] -> [False] 10/21/2024 02:01:19.938 7f4d45cc3d88 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:01:20.230 7f4d45cc3d88 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 10/21/2024 02:01:20.232 7f4d40d8dac8 [contrail-analytics-api] [ERROR]: Cannot write http_port 8090 to /tmp/contrail-analytics-api.0.http_port 10/21/2024 02:01:20.232 7f4d40d8dac8 [contrail-analytics-api] [ERROR]: Starting Introspect on HTTP Port 8090 10/21/2024 02:01:20.232 7f4d40d92438 [contrail-analytics-api] [INFO]: Processing event[EvStart] in state[none] 10/21/2024 02:01:20.233 7f4d40d92438 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/21/2024 02:01:20.234 7f4d40d92438 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 10/21/2024 02:01:20.234 7f4d40d92438 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:20.235 7f4d40d92438 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, ] description = >>, ] >> 10/21/2024 02:01:20.246 7f4d40d92438 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:20.246 7f4d40d92438 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:20.246 7f4d40d92438 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Initializing description = Redis Instance initialized >>, ] description = Redis-UVE:10.0.0.30:6379[Redis Instance initialized] connection down >>, ] >> 10/21/2024 02:01:20.246 7f4d40d92438 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:20.246 7f4d40d92438 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:20.247 7f4d40d92438 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, ] description = Redis-UVE:10.0.0.30:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized] connection down >>, ] >> 10/21/2024 02:01:20.247 7f4d40d92438 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:20.247 7f4d40d92438 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:20.249 7f4d40d92438 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] AnalyticsApiInfoUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 analytics_node_ip = { rest_api_ip : 10.0.0.30host_ip : 10.0.0.30 } >> 10/21/2024 02:01:20.249 7f4d40d92438 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:20.249 7f4d40d92438 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:20.249 7f4d40d92438 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Redis-UVE:10.0.0.30:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/21/2024 02:01:20.249 7f4d40d92438 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:20.249 7f4d40d92438 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:20.249 7f4d40d92438 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 5 max_sm_queue_count = 5 >> 10/21/2024 02:01:20.249 7f4d40d92438 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:20.251 7f4d43c8af60 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 10/21/2024 02:01:20.271 7f4d40d016d8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:20.272 7f4d40d016d8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Initializing description = Connection to API Server initialized >>, ] description = Redis-UVE:10.0.0.30:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[Connection to API Server initialized] connection down >>, ] >> 10/21/2024 02:01:20.272 7f4d40d016d8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:20.340 7f4d44354eb8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:20.341 7f4d44354eb8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Initializing description = Connection to API Server initialized >>, ] description = Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[Connection to API Server initialized] connection down >>, ] >> 10/21/2024 02:01:20.341 7f4d44354eb8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:20.345 7f4d402b6c18 [contrail-analytics-api] [INFO]: Analytics Discovery listen CONNECTED 10/21/2024 02:01:20.345 7f4d402b6c18 [contrail-analytics-api] [INFO]: Analytics Discovery to publish None 10/21/2024 02:01:20.347 7f4d402ccb70 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:20.353 7f4d402ccb70 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper re-established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Initializing description = Connection to API Server initialized >>, ] description = Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[Connection to API Server initialized] connection down >>, ] >> 10/21/2024 02:01:20.353 7f4d402ccb70 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:20.353 7f4d402ccb70 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:20.353 7f4d402ccb70 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Initializing description = Connection to API Server initialized >>, ] description = Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[Connection to API Server initialized] connection down >>, ] >> 10/21/2024 02:01:20.353 7f4d402ccb70 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:20.355 7f4d402cccc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:20.356 7f4d402cccc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[] connection down >>, ] >> 10/21/2024 02:01:20.356 7f4d402cccc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:20.373 7f4d43c8af60 [contrail-analytics-api] [INFO]: Analytics Discovery Watcher AlarmGenerator Children ['cn-jenkins-deploy-platform-juju-os-439-1-0'] 10/21/2024 02:01:20.376 7f4d43c8af60 [contrail-analytics-api] [INFO]: Analytics Discovery OpServer reconnect 10/21/2024 02:01:20.376 7f4d43c8af60 [contrail-analytics-api] [INFO]: ensure /analytics-discovery-/OpServer 10/21/2024 02:01:20.376 7f4d43c8af60 [contrail-analytics-api] [INFO]: zk state CONNECTED (CONNECTED) 10/21/2024 02:01:20.386 7f4d43c8af60 [contrail-analytics-api] [INFO]: check for /analytics-discovery-/OpServer/cn-jenkins-deploy-platform-juju-os-439-1-0 10/21/2024 02:01:20.390 7f4d43c8af60 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-juju-os-439-1-0, data b'{"ip-address": "10.0.0.30", "instance-id": "0", "redis-ip": "10.0.0.30", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{}"}', event None 10/21/2024 02:01:20.392 7f4d43c8af60 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-juju-os-439-1-0, data OrderedDict([('instance-id', '0'), ('ip-address', '10.0.0.30'), ('partitions', '{}'), ('redis-agg-db', 7), ('redis-ip', '10.0.0.30'), ('redis-port', '6379')]), event GET 10/21/2024 02:01:24.235 7f4d401bff60 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:01:28.957 7f4d402b6a20 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-juju-os-439-1-0, data b'{"ip-address": "10.0.0.30", "instance-id": "0", "redis-ip": "10.0.0.30", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{}"}', event WatchedEvent(type='CHANGED', state='CONNECTED', path='/analytics-discovery-/AlarmGenerator/cn-jenkins-deploy-platform-juju-os-439-1-0') 10/21/2024 02:01:29.238 7f4d401bff60 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:01:29.238 7f4d401bff60 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:01:29.238 7f4d401bff60 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:29.238 7f4d401bff60 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 10/21/2024 02:01:29.238 7f4d401bff60 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:29.238 7f4d401bff60 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:01:29.239 7f4d401bff60 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:01:29.239 7f4d401bff60 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:29.239 7f4d401bff60 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[] connection down >>, ] >> 10/21/2024 02:01:29.239 7f4d401bff60 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:29.239 7f4d401bff60 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:29.240 7f4d401bff60 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:01:29.240 7f4d401bff60 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:30.777 7f4d402b6a20 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-juju-os-439-1-0, data b'{"ip-address": "10.0.0.30", "instance-id": "0", "redis-ip": "10.0.0.30", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{\\"10\\": 1729476090066520, \\"9\\": 1729476090069591, \\"8\\": 1729476090071180, \\"7\\": 1729476090074224, \\"6\\": 1729476090077038, \\"5\\": 1729476090079368, \\"4\\": 1729476090080726, \\"3\\": 1729476090082284, \\"2\\": 1729476090083565, \\"1\\": 1729476090084883, \\"0\\": 1729476090086219, \\"20\\": 1729476090196918, \\"18\\": 1729476090216088, \\"16\\": 1729476090239934, \\"11\\": 1729476090434046, \\"15\\": 1729476090463101, \\"14\\": 1729476090463406, \\"13\\": 1729476090464879, \\"12\\": 1729476090496488}"}', event WatchedEvent(type='CHANGED', state='CONNECTED', path='/analytics-discovery-/AlarmGenerator/cn-jenkins-deploy-platform-juju-os-439-1-0') 10/21/2024 02:01:31.533 7f4d402b6a20 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-juju-os-439-1-0, data b'{"ip-address": "10.0.0.30", "instance-id": "0", "redis-ip": "10.0.0.30", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{\\"10\\": 1729476090066520, \\"9\\": 1729476090069591, \\"8\\": 1729476090071180, \\"7\\": 1729476090074224, \\"6\\": 1729476090077038, \\"5\\": 1729476090079368, \\"4\\": 1729476090080726, \\"3\\": 1729476090082284, \\"2\\": 1729476090083565, \\"1\\": 1729476090084883, \\"0\\": 1729476090086219, \\"20\\": 1729476090196918, \\"18\\": 1729476090216088, \\"16\\": 1729476090239934, \\"11\\": 1729476090434046, \\"15\\": 1729476090463101, \\"14\\": 1729476090463406, \\"13\\": 1729476090464879, \\"12\\": 1729476090496488, \\"24\\": 1729476090517841, \\"21\\": 1729476090519047, \\"19\\": 1729476090519297, \\"17\\": 1729476090519515, \\"25\\": 1729476090542885, \\"23\\": 1729476090543302, \\"22\\": 1729476090543672, \\"29\\": 1729476090599112, \\"28\\": 1729476090600645, \\"27\\": 1729476090613356, \\"26\\": 1729476090614458}"}', event WatchedEvent(type='CHANGED', state='CONNECTED', path='/analytics-discovery-/AlarmGenerator/cn-jenkins-deploy-platform-juju-os-439-1-0') 10/21/2024 02:01:33.242 7f4d40067978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:01:33.427 7f4d40067eb8 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:01:38.247 7f4d40067978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:01:38.248 7f4d40067978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:01:38.248 7f4d40067978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:38.249 7f4d40067978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 10/21/2024 02:01:38.249 7f4d40067978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:38.249 7f4d40067978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:01:38.249 7f4d40067978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:01:38.249 7f4d40067978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:38.250 7f4d40067978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[] connection down >>, ] >> 10/21/2024 02:01:38.250 7f4d40067978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:38.250 7f4d40067978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:38.251 7f4d40067978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:01:38.252 7f4d40067978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:40.395 7f4d3bf9b588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:40.396 7f4d3bf9b588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[] connection down >>, ] >> 10/21/2024 02:01:40.397 7f4d3bf9b588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:42.249 7f4d4014f978 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:01:47.253 7f4d4014f978 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:01:47.253 7f4d4014f978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:01:47.253 7f4d4014f978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:47.253 7f4d4014f978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[] connection down >>, ] >> 10/21/2024 02:01:47.254 7f4d4014f978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:47.254 7f4d4014f978 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:01:47.254 7f4d4014f978 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:01:47.254 7f4d4014f978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:47.254 7f4d4014f978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[] connection down >>, ] >> 10/21/2024 02:01:47.254 7f4d4014f978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:47.254 7f4d4014f978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:47.255 7f4d4014f978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:01:47.255 7f4d4014f978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:47.551 7f4d45c78438 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:47.551 7f4d45c78438 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:01:47.552 7f4d45c78438 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:50.760 7f4d45c78438 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:01:51.253 7f4d3bfd0780 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:01:51.584 7f4d45c78438 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbYPqhKZ9DJA_b4r8JxmQ8THTzZruCqVpYgWr9vrF3jX6PA_opRTNwNpbn4wXOOtaaZd12P2e0pCIrdJxSrenCSvMb_aCWUB_l8VIrrvP10xU3YL92Xo-aYIkz7AIxmNNwDie4ck5yq_IXVsf1v9S2kOPbVIEkzKzs__p0jwB3lJd9Y 10/21/2024 02:01:51.584 7f4d45c78438 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:01:51.586 7f4d3bfd0588 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 2062 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:01:51.587 7f4d3bfd0588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 2062 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:01:52.115 7f4d401f0f60 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbYPN-taEYc5mgposKWBTM8B8b9DdFhAnTnonezviXUvjYDb0y1qHddiNe3vEDLVer1f2p3CiE5DlekTOuc37DhqFfuzlYKYoYfw_t2zr8X398hUnVXJsTyWnrU7pqpqoHjhJbzWD7Kh5evDDrKoEly76M02smBtW6pYPfypikWN8wk 10/21/2024 02:01:52.115 7f4d401f0f60 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:01:52.119 7f4d3bfc72e8 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 2869 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:01:52.119 7f4d3bfc72e8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 2869 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:01:56.256 7f4d3bfd0780 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:01:56.257 7f4d3bfd0780 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:01:56.257 7f4d3bfd0780 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:56.257 7f4d3bfd0780 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:01:56.257 7f4d3bfd0780 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:56.257 7f4d3bfd0780 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:01:56.258 7f4d3bfd0780 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:01:56.258 7f4d3bfd0780 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:56.258 7f4d3bfd0780 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:01:56.258 7f4d3bfd0780 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:56.258 7f4d3bfd0780 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:56.258 7f4d3bfd0780 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:01:56.258 7f4d3bfd0780 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:00.260 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:02:05.266 7f4d3bfc72e8 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:02:05.267 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:02:05.267 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:05.267 7f4d3bfc72e8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:02:05.267 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:05.267 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:02:05.268 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:02:05.268 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:05.269 7f4d3bfc72e8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:02:05.269 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:05.269 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:05.269 7f4d3bfc72e8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:02:05.269 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:06.596 7f4d3bfc72e8 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 10/21/2024 02:02:07.743 7f4d3bfc72e8 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 10/21/2024 02:02:09.268 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:02:11.465 7f4d3bfd0a20 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:02:14.276 7f4d3bfc72e8 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:02:14.276 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:02:14.276 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:14.276 7f4d3bfc72e8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:02:14.276 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:14.277 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:02:14.277 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:02:14.277 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:14.277 7f4d3bfc72e8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:02:14.277 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:14.277 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:14.277 7f4d3bfc72e8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:02:14.278 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:18.278 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:02:23.283 7f4d3bfc72e8 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:02:23.283 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:02:23.283 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:23.284 7f4d3bfc72e8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:02:23.284 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:23.284 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:02:23.284 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:02:23.284 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:23.285 7f4d3bfc72e8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:02:23.285 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:23.285 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:23.287 7f4d3bfc72e8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:02:23.288 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:27.285 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:02:32.289 7f4d3bfc72e8 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:02:32.289 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:02:32.289 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:32.289 7f4d3bfc72e8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:02:32.290 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:32.290 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:02:32.290 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:02:32.290 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:32.290 7f4d3bfc72e8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:02:32.290 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:32.290 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:32.291 7f4d3bfc72e8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:02:32.291 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:36.290 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:02:41.293 7f4d3bfc72e8 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:02:41.293 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:02:41.293 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:41.293 7f4d3bfc72e8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:02:41.294 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:41.294 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:02:41.294 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:02:41.294 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:41.295 7f4d3bfc72e8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:02:41.295 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:41.295 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:41.295 7f4d3bfc72e8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:02:41.295 7f4d3bfc72e8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:45.294 7f4d3bfd0198 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:02:45.300 7f4d3bfc72e8 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:02:50.299 7f4d3bfd0198 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:02:50.299 7f4d3bfd0198 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:02:50.299 7f4d3bfd0198 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:50.299 7f4d3bfd0198 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:02:50.299 7f4d3bfd0198 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:50.299 7f4d3bfd0198 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:02:50.300 7f4d3bfd0198 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:02:50.300 7f4d3bfd0198 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:50.300 7f4d3bfd0198 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:02:50.300 7f4d3bfd0198 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:50.300 7f4d3bfd0198 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:50.300 7f4d3bfd0198 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:02:50.300 7f4d3bfd0198 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:52.610 7f4d40156630 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbZMZCHl-fzEAJRfGj1Ve1le-OmHypBjsVypxC30gYXLTPcSQXSLsRvEjZ8VnsynQbrMgz71Q0nRYtZSJzmrrw3eDfW8ekEgxA-Ri9bxNKJINWPs-ByzUsSF37YHwOduAs4mtUph4kYFdbGv2NARe0IHMhwAq8KMl8R6BMgbxGmDGNY 10/21/2024 02:02:52.610 7f4d40156630 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:02:52.611 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 732 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:02:53.082 7f4d40156630 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbZMxTh4mQrfa1I73PXDOYApDLEpTB2wyNuwEkk1IU1jLnPx21vo9lCuBRp5k-a2THu9lL-HJcwIuypV6MQ2zmCzFIok4qrq_SFERJvsMqU4_9lWOtGcuUenIVZ92lLXXAAwZalBeRA9Q4Gw4hNackOAIFclPqJ1YOvonQSIfuyJLDE 10/21/2024 02:02:53.083 7f4d40156630 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:02:53.083 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 788 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:02:54.300 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:02:59.307 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:02:59.307 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:02:59.307 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:59.308 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:02:59.308 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:59.308 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:02:59.308 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:02:59.308 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:59.308 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:02:59.308 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:59.309 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:59.309 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:02:59.309 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:03.307 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:03:08.312 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:03:08.312 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:03:08.312 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:08.313 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:03:08.313 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:08.313 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:03:08.313 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:03:08.313 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:08.314 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:03:08.314 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:08.314 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:08.314 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:03:08.314 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:12.314 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:03:16.504 7f4d401f4eb8 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:03:17.317 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:03:17.317 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:03:17.317 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:17.317 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:03:17.317 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:17.317 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:03:17.318 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:03:17.318 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:17.318 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:03:17.318 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:17.318 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:17.318 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:03:17.318 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:21.318 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:03:26.320 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:03:26.320 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:03:26.320 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:26.320 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:03:26.320 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:26.320 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:03:26.321 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:03:26.321 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:26.321 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:03:26.321 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:26.321 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:26.321 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:03:26.321 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:30.321 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:03:30.664 7f4d3bfd0240 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:03:35.327 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:03:35.327 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:03:35.327 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:35.327 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:03:35.327 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:35.327 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:03:35.328 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:03:35.328 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:35.328 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:03:35.328 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:35.328 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:35.328 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:03:35.328 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:39.329 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:03:44.332 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:03:44.333 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:03:44.333 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:44.333 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:03:44.333 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:44.333 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:03:44.334 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:03:44.334 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:44.334 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:03:44.334 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:44.334 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:44.334 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:03:44.334 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:48.334 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:03:53.337 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:03:53.337 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:03:53.337 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:53.337 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:03:53.337 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:53.337 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:03:53.338 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:03:53.338 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:53.338 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:03:53.338 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:53.338 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:53.338 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:03:53.338 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:53.561 7f4d40156630 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbaJb9FtXxpGILvWb1CO8uyaGftFxh04_4SFKH7PE1cUPhUSf3jHAEeAMtoJqN1GsAnpLWf5tOa_Z7zkj8wJSQxNKq8IPNmLa2jgyRFGDREh02Lim5HEJZwK4J4YG0t_qo91SV4V_UtkD8LAH5sK6YKPUcpOU2ZyHEhDhKLnBT6_3qs 10/21/2024 02:03:53.562 7f4d40156630 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:03:53.562 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 549 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:03:54.029 7f4d40156630 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbaJmVSARFUdCp8prKrbJVVrOEh6nJwGzxL39XxuL4e4lhhB9b4J_CBPnTGPXsJCA5krISnWRwhmuz1_Lpsv_7gdqC7UXPdL1-SEysySOIB16zbdB-RwEkfS8wtmlj21aHojaRp7-KL23kkeIuOYASOlP2nZ1xgnUMguMqgTwFP6mDE 10/21/2024 02:03:54.030 7f4d40156630 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:03:54.030 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 586 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:03:57.338 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:04:02.342 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:04:02.342 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:04:02.342 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:02.342 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:04:02.342 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:02.342 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:04:02.343 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:04:02.343 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:02.343 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:04:02.343 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:02.343 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:02.343 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:04:02.343 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:06.343 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:04:11.346 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:04:11.346 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:04:11.346 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:11.346 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:04:11.347 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:11.347 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:04:11.347 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:04:11.347 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:11.348 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:04:11.348 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:11.348 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:11.348 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:04:11.348 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:15.350 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:04:20.357 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:04:20.358 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:04:20.358 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:20.358 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:04:20.358 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:20.358 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:04:20.359 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:04:20.359 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:20.359 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:04:20.359 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:20.359 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:20.359 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:04:20.359 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:24.358 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:04:29.365 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:04:29.365 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:04:29.365 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:29.365 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:04:29.365 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:29.366 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:04:29.366 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:04:29.366 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:29.366 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:04:29.366 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:29.366 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:29.367 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:04:29.367 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:33.368 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:04:38.373 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:04:38.373 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:04:38.373 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:38.373 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:04:38.373 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:38.374 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:04:38.374 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:04:38.374 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:38.374 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:04:38.374 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:38.374 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:38.375 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:04:38.375 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:42.376 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:04:47.379 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:04:47.379 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:04:47.379 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:47.380 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:04:47.380 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:47.380 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:04:47.381 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:04:47.381 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:47.381 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:04:47.381 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:47.381 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:47.382 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:04:47.382 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:49.683 7f4d40156630 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:04:51.380 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:04:54.502 7f4d402046d8 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbbG206-QJgyJk_1tur7wkI9qBdg7HquGsCykDvV_Loqvk4AAtvk5E17haY6x5VTd-59prOCk-hwDxqe1eKeDTvAVEZjUxCpOEKw42seQQRqkXJRT9l1J9Y5x7zYtuLhphcV_V8CMX6Jh4TSr57cpvMiSyGPN_EtIDptJzZi9nuWCCc 10/21/2024 02:04:54.503 7f4d402046d8 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:04:54.504 7f4d401fb240 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 883 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:04:54.504 7f4d401fb240 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 883 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:04:54.977 7f4d402046d8 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbbGPtS2CW693FQR7iJvGbmQPSfpo48npcn1MriOkmZ8OnlKoroMbI8PrLMkaHxXv88bHKo8KNU8GHxpBQcDYAx0gh5IO62kYmhG2_pbyxvKuAQuC5OUDOEybsnQA-4_tfUVsbniM--zJV7T_UqZMeVTon-942qJ6m4xANZzjk4o1Pg 10/21/2024 02:04:54.977 7f4d402046d8 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:04:54.978 7f4d3bfc72e8 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 845 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:04:54.978 7f4d3bfc72e8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 845 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:04:56.383 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:04:56.383 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:04:56.383 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:56.383 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:04:56.383 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:56.383 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:04:56.384 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:04:56.384 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:56.384 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:04:56.384 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:56.384 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:56.384 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:04:56.384 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:00.386 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:05:04.943 7f4d3bfd0240 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:05:05.389 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:05:05.390 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:05:05.390 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:05.390 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:05:05.390 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:05.390 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:05:05.391 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:05:05.391 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:05.391 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:05:05.391 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:05.391 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:05.391 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:05:05.391 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:09.393 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:05:14.395 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:05:14.396 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:05:14.396 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:14.396 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:05:14.396 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:14.396 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:05:14.397 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:05:14.397 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:14.397 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:05:14.397 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:14.397 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:14.397 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:05:14.397 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:18.398 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:05:19.033 7f4d3bfc78d0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:05:23.401 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:05:23.401 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:05:23.401 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:23.401 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:05:23.401 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:23.402 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:05:23.402 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:05:23.402 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:23.402 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:05:23.402 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:23.402 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:23.403 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:05:23.403 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:27.403 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:05:32.407 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:05:32.408 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:05:32.408 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:32.408 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:05:32.408 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:32.408 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:05:32.409 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:05:32.409 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:32.410 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:05:32.410 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:32.410 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:32.410 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:05:32.410 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:36.408 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:05:41.411 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:05:41.411 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:05:41.412 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:41.412 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:05:41.412 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:41.412 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:05:41.412 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:05:41.413 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:41.413 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:05:41.413 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:41.413 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:41.413 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:05:41.413 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:45.414 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:05:50.420 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:05:50.420 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:05:50.420 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:50.420 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:05:50.420 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:50.420 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:05:50.421 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:05:50.421 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:50.421 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:05:50.421 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:50.422 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:50.422 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:05:50.422 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:54.420 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:05:55.459 7f4d40218f60 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbcDGWbOCsPtVYNU05NYAyY-KakH75i4NmRFvB2Y3HTuOzbVwo4DFLUaoftlvoio9tUs7A-bMERSFNDvVFpnuDR_20yAIn_hHYCU1fZnVI7V0dWvh-xxqKhckDpMM-jhPp27iAqF-zl2BwddSFC3tvg5y9qetTC9FX7XijrJoQ0J4uQ 10/21/2024 02:05:55.459 7f4d40218f60 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:05:55.460 7f4d457b0978 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 541 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:05:55.460 7f4d457b0978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 541 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:05:56.014 7f4d457b0978 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbcDA9GHayWxcs9Fk_SxibvyNJWwuZW7_xVAMFvDRAPX2AKkW_EZsk5qYCtIKeixqpPmMYhG-OOPMe5bKSGO2cCZOMUoeFUjmyZqqv_B-lTzpRPidOaD1AgoWpR8O-lQ1mTfpvMt3GVD25YxM_qiZ1f1WT4h2_B9l5xyBSH_paJ1BLQ 10/21/2024 02:05:56.014 7f4d457b0978 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:05:56.015 7f4d401f0780 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 534 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:05:56.015 7f4d401f0780 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 534 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:05:58.962 7f4d457b0978 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:05:59.422 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:05:59.423 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:05:59.423 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:59.423 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:05:59.423 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:59.423 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:05:59.424 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:05:59.424 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:59.424 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:05:59.424 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:59.424 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:59.424 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:05:59.424 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:03.425 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:06:08.432 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:06:08.432 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:06:08.432 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:08.432 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:06:08.433 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:08.433 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:06:08.433 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:06:08.433 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:08.433 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:06:08.433 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:08.433 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:08.434 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:06:08.434 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:12.434 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:06:17.437 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:06:17.437 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:06:17.437 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:17.437 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:06:17.437 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:17.438 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:06:17.438 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:06:17.438 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:17.438 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:06:17.438 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:17.438 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:17.438 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:06:17.439 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:21.438 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:06:26.441 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:06:26.441 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:06:26.441 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:26.441 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:06:26.441 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:26.441 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:06:26.442 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:06:26.442 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:26.442 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:06:26.442 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:26.442 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:26.443 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:06:26.443 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:30.441 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:06:35.443 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:06:35.444 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:06:35.444 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:35.444 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:06:35.444 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:35.444 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:06:35.445 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:06:35.445 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:35.445 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:06:35.445 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:35.445 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:35.445 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:06:35.445 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:39.447 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:06:44.453 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:06:44.453 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:06:44.453 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:44.453 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:06:44.453 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:44.453 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:06:44.454 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:06:44.454 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:44.454 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:06:44.454 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:44.454 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:44.454 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:06:44.454 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:48.456 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:06:53.460 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:06:53.461 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:06:53.461 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:53.461 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:06:53.461 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:53.461 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:06:53.462 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:06:53.462 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:53.462 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:06:53.462 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:53.462 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:53.463 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:06:53.463 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:56.499 7f4d40156630 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbdA91u3dBV740N6cIXHjK3fsXk3j_3qBr9soiAVq7HtmObuoTLXckZT5pejRk8_nmFolSLK-YMGZgb87hQ-S7PNuiSMr-6s5ZNErqIuF7FPbjZw50K-GPa5fV9QKPHCfs-u1JWckMM4fRS3DT2dLQYpvr7rpcOqpnlaBa2KbtPdmyM 10/21/2024 02:06:56.499 7f4d40156630 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:06:56.499 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 557 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:06:56.973 7f4d40156630 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbdAiIvNlen7NA9NLWM8Zc6LO8D7NhUc8jMK-fZUP6zajbVXd7oHltv7cTqoXze_xdzlZf4KZ4aaUd-IfvZrvAmrH4FbIcz1CRUKNTpR1GpxWJCMC8WA4BETCj0PpYf_r2_IAVS-BRLVucWzTyCT4C7RkTX0mXEHBjrMZJ3AREu09z8 10/21/2024 02:06:56.974 7f4d40156630 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:06:56.974 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 643 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:06:57.461 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:07:02.465 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:07:02.465 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:07:02.465 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:02.466 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:07:02.466 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:02.466 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:07:02.466 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:07:02.467 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:02.467 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:07:02.467 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:02.467 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:02.467 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:07:02.467 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:05.412 7f4d40156630 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 10/21/2024 02:07:06.466 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:07:06.570 7f4d401f4b70 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 10/21/2024 02:07:11.469 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:07:11.469 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:07:11.469 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:11.469 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:07:11.469 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:11.470 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:07:11.470 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:07:11.470 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:11.470 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:07:11.470 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:11.470 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:11.471 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:07:11.471 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:15.470 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:07:20.472 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:07:20.473 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:07:20.473 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:20.473 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:07:20.473 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:20.473 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:07:20.474 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:07:20.474 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:20.474 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:07:20.474 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:20.474 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:20.474 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:07:20.474 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:24.476 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:07:29.482 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:07:29.482 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:07:29.482 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:29.483 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:07:29.483 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:29.483 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:07:29.483 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:07:29.484 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:29.484 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:07:29.484 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:29.484 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:29.484 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:07:29.484 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:33.485 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:07:38.489 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:07:38.490 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:07:38.490 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:38.490 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:07:38.490 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:38.490 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:07:38.491 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:07:38.491 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:38.491 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:07:38.491 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:38.491 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:38.491 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:07:38.491 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:42.492 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:07:47.494 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:07:47.495 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:07:47.495 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:47.495 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:07:47.495 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:47.495 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:07:47.496 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:07:47.496 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:47.496 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:07:47.496 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:47.496 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:47.496 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:07:47.496 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:51.495 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:07:56.498 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:07:56.498 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:07:56.499 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:56.499 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:07:56.499 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:56.499 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:07:56.500 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:07:56.500 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:56.500 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:07:56.500 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:56.501 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:56.501 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:07:56.501 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:57.448 7f4d40156630 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbd9lSRpwW2W0jXi-hqFR0zaJPzN0leZzy9GVCAt5KSemh54JPep-wAnfD_OKWO19at-cs1tcR3FttUCnEfm3RN5PrvCyHrBmoPZnwE278i41uNtGPCNeB0zTP3JmcAzeCizdgOkMnuW7Nbv7nu5jRxQZpw5Fm22KlwwhFkcO1FSPGo 10/21/2024 02:07:57.448 7f4d40156630 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:07:57.449 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 607 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:07:57.922 7f4d40156630 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbd9OsLiAe1ufnxcXNyMVlS4Eh4zak__mSjIaDxmv_rTCIJiK4BWYYwAvT-fAwjcPi5Iw_Rhvn-TR4OVdAh1BUF6xTZusXF3yQGMC9-whtkn-tKTudtMOUR4M0ziEpzrSmWQpHn9cbH_m00jiCs9wbIvfIvBIIZjgYBM-6TG_vXmDIo 10/21/2024 02:07:57.922 7f4d40156630 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:07:57.922 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 559 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:08:00.499 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:08:05.502 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:08:05.502 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:08:05.502 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:05.502 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:08:05.503 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:05.503 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:08:05.503 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:08:05.503 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:05.504 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:08:05.504 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:05.504 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:05.504 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:08:05.504 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:09.506 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:08:14.512 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:08:14.512 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:08:14.512 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:14.512 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:08:14.513 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:14.513 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:08:14.513 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:08:14.513 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:14.513 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:08:14.514 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:14.514 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:14.514 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:08:14.514 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:18.513 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:08:23.519 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:08:23.519 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:08:23.519 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:23.519 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:08:23.519 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:23.519 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:08:23.520 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:08:23.520 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:23.520 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:08:23.520 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:23.520 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:23.520 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:08:23.520 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:27.521 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:08:32.524 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:08:32.525 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:08:32.525 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:32.525 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:08:32.525 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:32.525 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:08:32.526 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:08:32.526 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:32.526 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:08:32.526 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:32.526 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:32.526 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:08:32.526 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:36.526 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:08:41.529 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:08:41.529 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:08:41.529 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:41.529 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:08:41.530 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:41.530 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:08:41.530 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:08:41.530 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:41.531 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:08:41.531 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:41.531 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:41.531 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:08:41.531 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:45.530 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:08:50.533 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:08:50.533 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:08:50.533 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:50.534 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:08:50.534 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:50.534 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:08:50.534 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:08:50.535 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:50.535 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:08:50.535 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:50.535 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:50.535 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:08:50.535 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:54.537 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:08:58.404 7f4d401fbb70 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbe67WZgA-WAJS9sr3RpX_HRmLDxJvuK8YZJEtf1T1iZswWIOkIYzACFjN5GKofQCpBEq6GUpwXNXuNEOP5ndHBEo0Q6Bsgs4eNrBH_x9HO-Gxf8nrbGbuAloHkFFX3n02kMaHP6ddCWrxU-V38iQsGFNWuWvjRywQ620K7mh3NKYyQ 10/21/2024 02:08:58.404 7f4d401fbb70 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:08:58.405 7f4d402048d0 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 600 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:08:58.405 7f4d402048d0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 600 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:08:58.878 7f4d40204198 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbe6Jrw76y7JG8-GlTc3rCMSRQDf25MAHGgyvOLDM0IdvLYf_jwGw4Z2TaW_FL4RExYJuoS-vsgxKVcABQY24QVrnmmdbvdSvWhbMxqA_izS4rf2aTmfXw_oB2Wh-H_ouO_hr4EY2daWzvoBxf9bOYuNqaP8khe4S-1XaEJZvkTzCSo 10/21/2024 02:08:58.878 7f4d40204198 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:08:58.879 7f4d40204a20 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 603 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:08:58.879 7f4d40204a20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 603 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:08:59.539 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:08:59.539 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:08:59.539 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:59.540 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:08:59.540 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:59.540 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:08:59.540 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:08:59.540 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:59.541 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:08:59.541 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:59.541 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:59.541 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:08:59.541 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:03.541 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:09:04.078 7f4d40204cc0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:09:08.544 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:09:08.544 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:09:08.544 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:08.545 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:09:08.545 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:08.545 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:09:08.546 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:09:08.546 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:08.546 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:09:08.546 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:08.546 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:08.547 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:09:08.547 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:12.545 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:09:17.549 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:09:17.549 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:09:17.549 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:17.549 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:09:17.550 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:17.550 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:09:17.550 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:09:17.550 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:17.550 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:09:17.550 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:17.551 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:17.551 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:09:17.551 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:17.997 7f4d40156630 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:09:21.551 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:09:26.553 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:09:26.553 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:09:26.553 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:26.553 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:09:26.553 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:26.554 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:09:26.554 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:09:26.554 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:26.554 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:09:26.554 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:26.555 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:26.555 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:09:26.555 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:30.554 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:09:34.993 7f4d401fbf60 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:09:35.556 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:09:35.557 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:09:35.557 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:35.557 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:09:35.557 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:35.557 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:09:35.558 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:09:35.558 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:35.558 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:09:35.559 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:35.559 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:35.559 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:09:35.559 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:39.558 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:09:44.563 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:09:44.563 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:09:44.563 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:44.564 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:09:44.564 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:44.564 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:09:44.565 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:09:44.565 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:44.565 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:09:44.565 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:44.565 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:44.565 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:09:44.565 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:48.566 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:09:53.571 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:09:53.571 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:09:53.571 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:53.571 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:09:53.571 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:53.571 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:09:53.572 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:09:53.572 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:53.572 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:09:53.572 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:53.572 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:53.572 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:09:53.572 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:57.574 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:09:59.352 7f4d3bfd06d8 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbf3wxUJqv7yiZg3ZNWg9HhCI1OBfulPKlQU3oNjfZ7iY0SfUHLWVgiK82LNBpxt_I96wMNjpJ_6G5pluH-Me5PPE7Kx1hwimmEs5Lhk7PEifc-iXjC_LXflT8dtWknyIQUasxarrtwQiInnPX_cEFpwjARfBPnZ6S5AwDMYXofzxi0 10/21/2024 02:09:59.352 7f4d3bfd06d8 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:09:59.352 7f4d40203390 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 548 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:09:59.353 7f4d40203390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 548 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:09:59.797 7f4d3bfcb048 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:09:59.830 7f4d3bfd06d8 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbf3VpkXemJviFbXCAWWiO5b7qC_KjrYxnf0-m5rus_7UYVWt8_K19k0vAb_NNBkc9ZznileG18GoSl-0i_-ag4I7Tnsyw3OWbCMLCn6YQVrbiaH5VFZDWMo6ZbAJrOwn73hrfjQsE_jD9n0bY7pFzh8V5HP8fiLI6PxtcVMeM_wp-s 10/21/2024 02:09:59.831 7f4d3bfd06d8 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:09:59.831 7f4d3bfdf828 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 502 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:09:59.831 7f4d3bfdf828 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 502 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:10:02.577 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:10:02.577 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:10:02.577 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:02.578 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:10:02.578 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:02.578 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:10:02.578 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:10:02.578 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:02.579 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:10:02.579 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:02.579 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:02.579 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:10:02.579 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:06.578 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:10:11.581 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:10:11.581 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:10:11.581 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:11.582 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:10:11.582 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:11.582 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:10:11.583 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:10:11.583 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:11.583 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:10:11.583 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:11.583 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:11.583 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:10:11.583 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:15.582 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:10:20.583 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:10:20.584 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:10:20.584 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:20.584 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:10:20.584 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:20.584 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:10:20.585 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:10:20.585 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:20.585 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:10:20.585 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:20.585 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:20.585 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:10:20.585 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:24.585 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:10:29.589 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:10:29.589 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:10:29.590 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:29.590 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:10:29.590 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:29.590 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:10:29.591 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:10:29.591 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:29.591 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:10:29.591 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:29.591 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:29.592 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:10:29.592 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:33.593 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:10:38.597 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:10:38.598 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:10:38.598 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:38.598 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:10:38.598 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:38.598 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:10:38.599 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:10:38.599 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:38.600 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:10:38.600 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:38.600 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:38.600 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:10:38.600 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:42.598 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:10:47.603 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:10:47.603 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:10:47.604 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:47.604 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:10:47.604 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:47.604 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:10:47.605 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:10:47.605 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:47.605 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:10:47.605 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:47.605 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:47.605 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:10:47.605 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:51.604 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:10:56.607 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:10:56.607 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:10:56.607 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:56.607 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:10:56.608 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:56.608 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:10:56.608 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:10:56.608 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:56.608 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:10:56.608 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:56.609 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:56.609 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:10:56.609 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:00.374 7f4d40156630 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbg0EBDFLhUwEq5_vqAwhos54IWqLcyeLGx_0u-_1XsWtgjYYTR1sIFXH1Bj0CZUSb4-SQ4KvyeYDIIoJ-sCvdEzKRMbBWrxwDvGgo87uJB4RO93vy89uDrVhxlr5NwECZ00tj8nihN7s73nutBjTjAA2_Na8Ce2W2ULND9X9wkF7VE 10/21/2024 02:11:00.375 7f4d40156630 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:11:00.375 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 582 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:11:00.607 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:11:00.849 7f4d3bfcc240 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbg04TJlXeK6tvlRycy6ZCY14k-qNR8urkNhJqaGbdkCDF3xktIr9qwavPQfC_WrN6AZrdZ7KEBDopiANnF3dr5-DzbZ_-l6up_ScMoasBMU-eQRAg25Rrdusr3zUg2NRO5yPlnHmLB8n4u8yL0AP84HRZTs5aMmymSv45TtsmqatZQ 10/21/2024 02:11:00.849 7f4d3bfcc240 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:11:00.850 7f4d3bfdf0f0 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 703 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:11:00.850 7f4d3bfdf0f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 703 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:11:05.610 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:11:05.610 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:11:05.610 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:05.611 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:11:05.611 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:05.611 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:11:05.611 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:11:05.611 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:05.612 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:11:05.612 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:05.612 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:05.612 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:11:05.612 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:09.611 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:11:14.617 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:11:14.618 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:11:14.618 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:14.618 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:11:14.618 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:14.618 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:11:14.619 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:11:14.619 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:14.619 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:11:14.619 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:14.619 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:14.619 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:11:14.619 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:18.619 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:11:20.258 7f4d3bfd0630 [contrail-analytics-api] [DEBUG]: resource list for database-node is None 10/21/2024 02:11:20.259 7f4d40d05240 [contrail-analytics-api] [INFO]: db usage:{} 10/21/2024 02:11:20.264 7f4d401f4d68 [contrail-analytics-api] [DEBUG]: resource list for database-node is None 10/21/2024 02:11:20.265 7f4d40d05240 [contrail-analytics-api] [INFO]: pending compaction tasks :{} 10/21/2024 02:11:23.621 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:11:23.621 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:11:23.621 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:23.622 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:11:23.622 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:23.622 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:11:23.622 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:11:23.622 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:23.622 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:11:23.623 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:23.623 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:23.623 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:11:23.623 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:27.622 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:11:32.626 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:11:32.626 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:11:32.626 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:32.626 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:11:32.626 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:32.626 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:11:32.627 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:11:32.627 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:32.627 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:11:32.627 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:32.627 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:32.627 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:11:32.627 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:36.627 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:11:41.633 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:11:41.633 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:11:41.633 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:41.633 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:11:41.633 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:41.634 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:11:41.634 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:11:41.634 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:41.634 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:11:41.634 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:41.634 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:41.634 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:11:41.635 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:45.635 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:11:50.637 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:11:50.638 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:11:50.638 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:50.638 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:11:50.638 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:50.638 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:11:50.639 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:11:50.639 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:50.639 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:11:50.639 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:50.639 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:50.639 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:11:50.639 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:54.638 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:11:59.643 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:11:59.643 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:11:59.643 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:59.643 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:11:59.644 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:59.644 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:11:59.644 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:11:59.644 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:59.644 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:11:59.644 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:59.645 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:59.645 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:11:59.645 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:01.333 7f4d40156630 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbhxq9eW2fmp3CnwuEgpxIyiAPCUcApw_4c9wqFuHx3xd3f-H9Rygv9x4J55MIyl9KYREmLWcZrqLc8N-Q-9T-aGDqusffxFBi5Tg5XEnMIcCoigGrbPJplPhYgF2yMsHBI0l6dmsnmuJ_0TgJEUJ_E4EMJadNyXewenl0EabwmC6CU 10/21/2024 02:12:01.333 7f4d40156630 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:12:01.333 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 522 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:12:01.899 7f4d40156630 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbhxE05kL75kgJgayc3rYA91v0VlXrFoglXXbH4WWwm8FH5fjiNiBOFhBfJV3__f18wsFYJE84fYGoRM-FJIgg0yiXrjtPVgUx3MFno86mzWD_hGVIVoMQGQ5-uHVlZRtpDgPoJ7YZwQNyCir_iiDLoHYoG0EuDNq-m5gTIVcaD6Vc8 10/21/2024 02:12:01.900 7f4d40156630 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:12:01.900 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 523 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:12:03.645 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:12:05.453 7f4d402038d0 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 10/21/2024 02:12:06.617 7f4d402038d0 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 10/21/2024 02:12:08.649 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:12:08.649 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:12:08.649 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:08.649 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:12:08.650 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:08.650 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:12:08.650 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:12:08.650 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:08.650 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:12:08.650 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:08.650 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:08.651 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:12:08.651 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:12.651 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:12:17.655 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:12:17.655 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:12:17.655 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:17.655 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:12:17.655 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:17.655 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:12:17.656 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:12:17.656 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:17.656 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:12:17.656 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:17.657 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:17.657 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:12:17.657 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:21.656 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:12:26.659 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:12:26.659 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:12:26.659 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:26.660 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:12:26.660 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:26.660 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:12:26.660 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:12:26.660 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:26.661 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:12:26.661 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:26.661 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:26.661 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:12:26.661 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:30.659 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:12:35.661 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:12:35.662 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:12:35.662 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:35.662 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:12:35.662 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:35.662 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:12:35.663 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:12:35.663 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:35.663 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:12:35.664 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:35.664 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:35.664 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:12:35.664 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:39.664 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:12:44.669 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:12:44.669 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:12:44.669 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:44.669 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:12:44.669 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:44.669 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:12:44.670 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:12:44.670 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:44.670 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:12:44.670 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:44.670 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:44.670 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:12:44.671 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:48.672 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:12:53.677 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:12:53.677 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:12:53.678 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:53.679 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:12:53.679 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:53.679 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:12:53.679 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:12:53.680 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:53.680 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:12:53.680 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:53.680 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:53.680 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:12:53.680 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:57.679 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:13:02.358 7f4d4006acc0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbiuDZPZBs-AZQJf5bL5Jj7jwXLhCtKWYxeTi5nEi_hUH8zl3GJjo_07ohyhkGxEuJ778aIXzBPedzML72MtQow5G5QKxGnxCmFNZMTpvx7L6WfKoYZoMm6a4eh6BzkLfOaIGoktOFbEvnaJYH7oLQWwsiIkYORX2ERF01Dny8dt7uU 10/21/2024 02:13:02.358 7f4d4006acc0 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:13:02.359 7f4d3bfd0978 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 576 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:13:02.359 7f4d3bfd0978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 576 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:13:02.681 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:13:02.682 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:13:02.682 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:02.682 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:13:02.682 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:02.682 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:13:02.683 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:13:02.683 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:02.683 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:13:02.683 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:02.684 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:02.684 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:13:02.684 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:02.827 7f4d40156630 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbiucp9mnG6pzFhU3ZlpH3O4rcc8eg-98UE0EYU8xH3aWTV2hxAwmfIrDOLPddWocEtmpJ4BReddLN9pmrvU-OmDemovz-EUkhEqyqEBT7ntejo1boy5Hm_heaC5EJRL7-7xt81bCQxulbUkwcfja1OrBo5IocJviELOXLI4qK30Niw 10/21/2024 02:13:02.827 7f4d40156630 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:13:02.828 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 521 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:13:06.683 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:13:11.686 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:13:11.686 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:13:11.686 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:11.686 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:13:11.686 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:11.686 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:13:11.687 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:13:11.687 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:11.687 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:13:11.687 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:11.687 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:11.687 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:13:11.687 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:14.978 7f4d40156630 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:13:15.686 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:13:20.689 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:13:20.689 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:13:20.689 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:20.689 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:13:20.689 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:20.689 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:13:20.690 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:13:20.690 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:20.690 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:13:20.690 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:20.690 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:20.691 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:13:20.691 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:24.693 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:13:28.794 7f4d40204048 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:13:29.696 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:13:29.696 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:13:29.696 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:29.696 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:13:29.696 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:29.697 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:13:29.697 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:13:29.697 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:29.697 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:13:29.697 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:29.697 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:29.698 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:13:29.698 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:33.697 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:13:38.702 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:13:38.702 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:13:38.702 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:38.702 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:13:38.703 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:38.703 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:13:38.703 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:13:38.703 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:38.703 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:13:38.703 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:38.704 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:38.704 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:13:38.704 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:42.704 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:13:45.941 7f4d3bfe7eb8 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:13:47.707 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:13:47.707 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:13:47.707 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:47.707 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:13:47.707 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:47.707 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:13:47.708 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:13:47.708 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:47.708 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:13:47.708 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:47.708 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:47.708 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:13:47.708 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:51.708 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:13:56.710 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:13:56.711 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:13:56.711 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:56.711 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:13:56.711 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:56.711 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:13:56.712 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:13:56.712 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:56.712 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:13:56.712 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:56.712 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:56.712 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:13:56.712 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:00.711 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:14:03.315 7f4d401fb780 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbjr0lsLDBvjoqY-64JOCQlVi76a0I6juH_5Vr24Q1r0Q3GrkSptBV0OHXkP1-U8vGXNA4YcShXXD91KZkMEZ5uePIEIbW3t8yenvp5pR-SXuimyEvK9aI5xDCtmSuJre9OEVCCk5HrMdmL1XOcG-3swZuBl2nJZJj4Nvh811xOiG88 10/21/2024 02:14:03.315 7f4d401fb780 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:14:03.316 7f4d40218f60 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 589 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:14:03.316 7f4d40218f60 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 589 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:14:03.778 7f4d401fb780 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbjr66ZpqeW7mi0wbArr3WQ1yiRIWNHLchWpg39bYdUf7aP8--hLW1pcu2huQuc5p_QhhjdpT8MgoIZtRoyVbUfrJ3gIAQHVv5XZerwriiz4SLHniq3GxEUvZgjDBfxMLzMJDxKyYH2RVv9mhV42p9FLLyntQxbWNQUR2vELbXzgADw 10/21/2024 02:14:03.779 7f4d401fb780 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:14:03.779 7f4d3bfe8828 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 542 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:14:03.779 7f4d3bfe8828 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 542 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:14:05.713 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:14:05.713 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:14:05.713 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:05.714 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:14:05.714 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:05.714 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:14:05.714 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:14:05.714 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:05.715 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:14:05.715 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:05.715 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:05.715 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:14:05.715 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:09.715 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:14:14.719 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:14:14.719 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:14:14.719 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:14.719 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:14:14.719 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:14.719 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:14:14.720 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:14:14.720 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:14.720 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:14:14.720 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:14.720 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:14.720 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:14:14.720 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:18.721 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:14:23.726 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:14:23.726 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:14:23.726 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:23.726 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:14:23.726 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:23.726 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:14:23.727 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:14:23.727 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:23.727 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:14:23.727 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:23.727 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:23.727 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:14:23.728 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:27.727 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:14:32.732 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:14:32.732 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:14:32.732 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:32.732 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:14:32.732 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:32.732 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:14:32.733 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:14:32.733 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:32.733 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:14:32.733 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:32.733 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:32.734 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:14:32.734 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:36.733 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:14:41.735 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:14:41.735 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:14:41.736 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:41.736 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:14:41.736 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:41.736 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:14:41.736 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:14:41.736 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:41.737 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:14:41.737 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:41.737 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:41.737 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:14:41.737 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:45.736 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:14:50.739 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:14:50.739 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:14:50.739 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:50.740 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:14:50.740 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:50.740 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:14:50.740 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:14:50.740 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:50.740 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:14:50.741 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:50.741 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:50.741 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:14:50.741 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:54.739 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:14:59.745 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:14:59.746 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:14:59.746 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:59.746 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:14:59.746 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:59.746 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:14:59.746 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:14:59.747 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:59.747 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:14:59.747 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:59.747 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:59.747 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:14:59.747 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:03.747 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:15:04.277 7f4d40218b70 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbkojbS66MJFegKb0UncVpCatLF7JesodQ-bkS2SNK54_Wo7b_m52JOfXekTDsn5iGACU8A0aW9poXv2pRI3Hdn2NGkaSY2VFD6vqEEIWv9f3rdEwIxLEz9rBCj5eSdPFIitqPCkDMN0S5oHTRgtMn34TTjZCpxzikR1sDt_QdvayEM 10/21/2024 02:15:04.277 7f4d40218b70 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:15:04.278 7f4d3bfdf8d0 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 603 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:15:04.278 7f4d3bfdf8d0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 603 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:15:04.766 7f4d40218b70 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbkowrXWdQ7ggJKNWP-pdOFSWViagN98oF-gnHT-LDu5diXnGq26S23DPNjBT3-13nql9D3OWnq3_ofzkBuHxo1hqtwBwq7m5nfKnQEsNtpgM2XM1qw1wjSAoFRqIT_oByUxJJVxyH3YdKVwlZM5gLo03rryoy1rJtvfazdbQ1fq_oA 10/21/2024 02:15:04.766 7f4d40218b70 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:15:04.767 7f4d401f0eb8 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 572 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:15:04.767 7f4d401f0eb8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 572 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:15:08.750 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:15:08.750 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:15:08.750 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:08.750 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:15:08.751 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:08.751 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:15:08.751 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:15:08.751 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:08.751 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:15:08.752 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:08.752 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:08.752 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:15:08.752 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:12.752 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:15:17.756 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:15:17.756 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:15:17.756 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:17.756 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:15:17.756 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:17.757 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:15:17.757 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:15:17.757 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:17.757 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:15:17.757 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:17.757 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:17.758 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:15:17.758 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:21.757 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:15:26.759 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:15:26.759 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:15:26.759 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:26.760 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:15:26.760 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:26.760 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:15:26.760 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:15:26.760 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:26.761 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:15:26.761 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:26.761 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:26.761 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:15:26.761 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:30.759 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:15:31.949 7f4d402042e8 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:15:35.762 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:15:35.762 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:15:35.762 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:35.762 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:15:35.762 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:35.762 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:15:35.763 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:15:35.764 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:35.764 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:15:35.764 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:35.764 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:35.764 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:15:35.764 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:39.765 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:15:44.770 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:15:44.770 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:15:44.770 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:44.770 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:15:44.771 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:44.771 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:15:44.772 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:15:44.772 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:44.772 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:15:44.772 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:44.772 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:44.772 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:15:44.773 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:48.773 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:15:53.778 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:15:53.778 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:15:53.778 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:53.779 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:15:53.779 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:53.779 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:15:53.779 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:15:53.780 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:53.780 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:15:53.780 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:53.780 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:53.780 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:15:53.780 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:57.780 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:16:02.785 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:16:02.785 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:16:02.785 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:02.785 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:16:02.785 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:02.786 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:16:02.786 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:16:02.786 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:02.786 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:16:02.786 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:02.786 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:02.787 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:16:02.787 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:05.243 7f4d40156630 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbllv2AymaFq9ybEWZJ2CPrze7so-yGALR7qwaCkpt3usR57D-DFvBjvXxMZql1S9E-vIqZ9MmHW_Dff6j0AHkh0chfJ23xIbOZthgsacMocZeILy-Fse6FysYroOq94u79OjSGFmor33suYtw25KiF8-IJwQRGgkqxonyLbrPMI4Dg 10/21/2024 02:16:05.244 7f4d40156630 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:16:05.244 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 652 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:16:05.704 7f4d40156630 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbllzq-YfT2cqwPz2gacxZa3EUpPGSAhVEc9Sg0d3-OIgLhrzwLypX7R-kTVh8jON4k2X1zIcZXOoiWQ34dGUsrzNFtp3DlWXVcp7C7zu4iNHxTDoRw8ofJei3svWohp9KQ7LsxxcmxB-M2O_UHTUSUniMGKnmq8OUamh6q2Apw9LPQ 10/21/2024 02:16:05.705 7f4d40156630 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:16:05.705 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 584 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:16:06.786 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:16:11.788 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:16:11.789 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:16:11.789 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:11.789 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:16:11.789 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:11.789 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:16:11.790 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:16:11.790 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:11.790 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:16:11.790 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:11.790 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:11.790 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:16:11.790 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:15.788 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:16:20.790 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:16:20.791 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:16:20.791 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:20.791 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:16:20.791 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:20.791 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:16:20.792 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:16:20.792 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:20.792 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:16:20.792 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:20.792 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:20.793 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:16:20.793 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:24.793 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:16:29.799 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:16:29.799 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:16:29.799 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:29.800 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:16:29.800 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:29.800 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:16:29.801 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:16:29.801 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:29.801 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:16:29.801 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:29.801 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:29.801 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:16:29.802 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:33.803 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:16:38.805 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:16:38.805 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:16:38.805 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:38.806 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:16:38.806 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:38.806 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:16:38.806 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:16:38.806 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:38.806 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:16:38.806 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:38.807 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:38.807 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:16:38.807 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:42.807 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:16:47.809 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:16:47.809 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:16:47.809 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:47.809 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:16:47.809 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:47.809 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:16:47.810 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:16:47.810 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:47.810 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:16:47.810 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:47.810 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:47.810 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:16:47.810 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:51.810 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:16:56.812 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:16:56.812 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:16:56.812 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:56.812 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:16:56.812 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:56.813 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:16:56.813 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:16:56.813 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:56.813 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:16:56.813 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:56.813 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:56.813 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:16:56.814 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:00.812 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:17:05.444 7f4d3bfeff60 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 10/21/2024 02:17:05.814 7f4d40156630 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:17:05.814 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:17:05.815 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:05.815 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:17:05.815 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:05.815 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:17:05.815 7f4d40156630 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:17:05.816 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:05.816 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:17:05.816 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:05.816 7f4d40156630 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:05.816 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:17:05.816 7f4d40156630 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:06.200 7f4d40156630 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbmimOM9rOmKCxljBTQCW8iz0Jm-4oJYBr4rO5DY6QqEQ3c_xDDFuk4hCSfOlZu8m9M_Y8iJMci1pltx13IeDNlqQZrNlgz6pjWvqPbVdMvnUKMJvUMqyhIdMfchiYXN0jgKqgljKvnwVMxrpm81I20AVw3N_JSRYAgE35puk7mDKOc 10/21/2024 02:17:06.200 7f4d40156630 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:17:06.201 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 784 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:17:06.626 7f4d40156630 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 10/21/2024 02:17:06.725 7f4d44354e10 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbmiN-0c4_1AZ_D_wZJh6rCqknE3aZXEci5wISSijmOlchKK-VJiH62-btfqta4JOUBrUnG2Pn2dv0NzftUnE8CnverIGC49kSJRxv-7Hfy3tem75pOvDUr9TuJpn55R5nYKuCydXGV-JfvkypEauuHGAld5Tx-mxYFCKYk7ts09SLw 10/21/2024 02:17:06.725 7f4d44354e10 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:17:06.726 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 547 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:17:09.817 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:17:14.821 7f4d44354e10 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:17:14.821 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:17:14.821 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:14.822 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:17:14.822 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:14.822 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:17:14.822 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:17:14.823 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:14.823 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:17:14.823 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:14.823 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:14.823 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:17:14.823 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:18.822 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:17:23.828 7f4d44354e10 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:17:23.828 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:17:23.828 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:23.829 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:17:23.829 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:23.829 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:17:23.829 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:17:23.829 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:23.830 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:17:23.830 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:23.830 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:23.830 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:17:23.830 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:25.291 7f4d44354e10 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:17:27.830 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:17:32.833 7f4d44354e10 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:17:32.833 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:17:32.833 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:32.833 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:17:32.833 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:32.833 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:17:32.834 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:17:32.834 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:32.834 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:17:32.834 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:32.834 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:32.834 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:17:32.834 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:36.835 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:17:40.538 7f4d3bfef240 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:17:41.838 7f4d44354e10 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:17:41.839 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:17:41.839 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:41.839 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:17:41.839 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:41.839 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:17:41.839 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:17:41.840 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:41.840 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:17:41.840 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:41.840 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:41.840 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:17:41.840 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:45.839 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:17:50.873 7f4d44354e10 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:17:50.873 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:17:50.874 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:50.874 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:17:50.874 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:50.874 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:17:50.874 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:17:50.875 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:50.875 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:17:50.875 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:50.875 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:50.875 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:17:50.875 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:54.877 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:17:57.822 7f4d40d01978 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:17:59.882 7f4d44354e10 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:17:59.883 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:17:59.883 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:59.883 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:17:59.883 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:59.883 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:17:59.884 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:17:59.884 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:59.884 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:17:59.885 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:59.885 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:59.885 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:17:59.885 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:03.885 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:18:07.277 7f4d401f0978 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbnfTSBuhLQrN6EyKMMjv7-fCT9wKNTk7LTIdaSWHQgo2E91eYgmqvhuBLwWLUakc3CdnvVcO05pqkyo4idiDO89T22F_o64WmZvyxuxC6AIvwQ8pVUvj-AliP-exLTG_VT4WsCA-yk4s5XwbG6ljuXdnvc4zr7F9CXFOjKdVN3nBgw 10/21/2024 02:18:07.277 7f4d401f0978 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:18:07.278 7f4d3bfc7d68 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 916 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:18:07.279 7f4d3bfc7d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 916 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:18:07.784 7f4d401f0978 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbnfLjMR0rmP-TzKLuro5-gQ-yT6RdoAmJt3lzm5gfyWMcajb6kKbv_5b1ajLWMtIye-rfgRe5tWtUGVTovIn-kZDGHZ6TiT9smXn_ugsk7BuJNF4wyQ3Xh_bhioKg9-sM-7w_KYtuoanBJBg9F_IbLecCzRirjpp0L2Us_9vVRDo8k 10/21/2024 02:18:07.785 7f4d401f0978 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:18:07.786 7f4d40204cc0 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 659 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:18:07.786 7f4d40204cc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 659 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:18:08.888 7f4d44354e10 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:18:08.888 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:18:08.888 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:08.889 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:18:08.889 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:08.889 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:18:08.890 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:18:08.890 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:08.890 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:18:08.890 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:08.890 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:08.890 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:18:08.891 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:12.889 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:18:17.893 7f4d44354e10 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:18:17.893 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:18:17.893 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:17.894 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:18:17.894 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:17.894 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:18:17.894 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:18:17.894 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:17.895 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:18:17.895 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:17.895 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:17.895 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:18:17.895 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:21.895 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:18:26.898 7f4d44354e10 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:18:26.898 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:18:26.898 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:26.898 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:18:26.898 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:26.898 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:18:26.899 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:18:26.899 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:26.899 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:18:26.899 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:26.899 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:26.899 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:18:26.899 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:30.898 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:18:35.901 7f4d44354e10 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:18:35.901 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:18:35.901 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:35.901 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:18:35.901 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:35.902 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:18:35.902 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:18:35.902 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:35.902 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:18:35.902 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:35.902 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:35.903 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:18:35.903 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:39.903 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:18:44.909 7f4d44354e10 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:18:44.909 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:18:44.909 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:44.910 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:18:44.910 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:44.910 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:18:44.910 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:18:44.910 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:44.910 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:18:44.910 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:44.910 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:44.911 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:18:44.911 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:48.912 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:18:53.917 7f4d44354e10 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:18:53.917 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:18:53.917 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:53.917 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:18:53.918 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:53.918 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:18:53.918 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:18:53.918 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:53.918 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:18:53.918 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:53.918 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:53.919 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:18:53.919 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:57.919 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:19:02.923 7f4d44354e10 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:19:02.923 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:19:02.923 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:02.924 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:19:02.924 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:02.924 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:19:02.924 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:19:02.924 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:02.924 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:19:02.925 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:02.925 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:02.925 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:19:02.925 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:06.924 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:19:08.305 7f4d40156630 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbocO4_SYcMAh1PvrBeHsAadUNHq8mEB87fMC1I2C-OwB3ogrhDOtce7CkODVCoo_JYZmB2WIDFY-0N_PLoFoavPr0Gx4LYbTzFZdR_US3Jcq8rlxaEjgmvTLDLl07m0dqq8NWmdxazeKoA82nN3tmWIEXwVWUBtHuxM86EhGV0aERc 10/21/2024 02:19:08.305 7f4d40156630 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:19:08.306 7f4d3bfcbf60 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 682 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:19:08.306 7f4d3bfcbf60 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 682 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:19:08.798 7f4d40156630 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbocbJI2ppu4B_qAUpVKUIVcTPNQihnXZ9f0YqSrNW_Tkz6AD9-dvxGj3dQo-wj1n_zLvasqaz204TwByQVF4hcKnmMRilYFKC4HaRHh89IGtskrE8-FNWZbmItMoLD3Rg_hAHR9RwmjwKBQHX6df7EPFeyx1V4QKrc-BLrTk6t6mcA 10/21/2024 02:19:08.798 7f4d40156630 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:19:08.799 7f4d3bfcc6d8 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 580 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:19:08.799 7f4d3bfcc6d8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 580 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:19:11.927 7f4d44354e10 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:19:11.928 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:19:11.928 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:11.928 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:19:11.928 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:11.928 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:19:11.929 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:19:11.929 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:11.929 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:19:11.929 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:11.929 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:11.929 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:19:11.929 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:15.928 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:19:20.930 7f4d44354e10 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:19:20.930 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:19:20.930 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:20.931 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:19:20.931 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:20.931 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:19:20.931 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:19:20.931 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:20.932 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:19:20.932 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:20.932 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:20.932 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:19:20.932 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:24.934 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:19:29.936 7f4d44354e10 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:19:29.937 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:19:29.937 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:29.937 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:19:29.937 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:29.937 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:19:29.938 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:19:29.938 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:29.938 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:19:29.938 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:29.938 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:29.939 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:19:29.939 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:33.939 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:19:38.944 7f4d44354e10 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:19:38.944 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:19:38.944 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:38.944 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:19:38.945 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:38.945 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:19:38.945 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:19:38.945 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:38.946 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:19:38.946 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:38.946 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:38.946 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:19:38.946 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:42.944 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:19:47.948 7f4d44354e10 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:19:47.948 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:19:47.948 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:47.948 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:19:47.948 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:47.949 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:19:47.949 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:19:47.949 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:47.949 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:19:47.949 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:47.949 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:47.949 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:19:47.950 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:51.949 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:19:56.953 7f4d44354e10 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:19:56.953 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:19:56.953 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:56.953 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:19:56.953 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:56.953 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:19:56.954 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:19:56.954 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:56.954 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:19:56.954 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:56.954 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:56.954 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:19:56.954 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:00.954 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:20:05.956 7f4d44354e10 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:20:05.957 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:20:05.957 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:05.957 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:20:05.957 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:05.957 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:20:05.958 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:20:05.958 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:05.958 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:20:05.958 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:05.958 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:05.958 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:20:05.958 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:09.326 7f4d44354e10 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbpZFPmsNS_zwytgv7KOB-JeG8VhpnVmydYRQJLnh732X7aaEaCZQLAL3dc7anuu6UAlrVLbUtNl-HtAnblI9S0W7OdwGANFqh4X0sIwLlpK1c1vE5gcbsAt2WN_s5wG2HX7kXOewEofT1TdehXhSmlS7q5iZQGhBFPVoDhdisS1d5k 10/21/2024 02:20:09.326 7f4d44354e10 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:20:09.327 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 552 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:20:09.814 7f4d44354e10 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbpZisrDXFvkkxU657fsh6wKgHzIx9jIvRLS91KG-gm0qZ7k7t9Hd1CjHkQjOFa_YIulG1X3vzz0DNVFXWs2CtnlUoW0o3ISHLWIlqxmvqUPgdelu1XEyyUYNe2Zhf-ERKLa9FvuFsqVXgCXGw8YJU1YEC-fTSzQ1yz0boqoCu3i1UY 10/21/2024 02:20:09.814 7f4d44354e10 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:20:09.815 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 824 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:20:09.957 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:20:14.963 7f4d44354e10 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:20:14.963 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:20:14.964 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:14.964 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:20:14.964 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:14.964 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:20:14.964 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:20:14.965 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:14.965 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:20:14.965 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:14.965 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:14.965 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:20:14.965 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:18.966 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:20:23.969 7f4d44354e10 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:20:23.969 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:20:23.969 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:23.969 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:20:23.969 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:23.970 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:20:23.970 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:20:23.970 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:23.970 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:20:23.970 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:23.970 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:23.971 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:20:23.971 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:27.971 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:20:32.975 7f4d44354e10 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:20:32.976 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:20:32.976 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:32.976 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:20:32.976 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:32.976 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:20:32.977 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:20:32.977 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:32.977 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:20:32.977 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:32.977 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:32.977 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:20:32.977 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:36.976 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:20:41.979 7f4d44354e10 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:20:41.980 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:20:41.980 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:41.980 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:20:41.980 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:41.981 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:20:41.981 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:20:41.981 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:41.982 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:20:41.982 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:41.982 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:41.982 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:20:41.982 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:45.980 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:20:50.982 7f4d44354e10 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:20:50.982 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:20:50.982 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:50.982 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:20:50.983 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:50.983 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:20:50.983 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:20:50.983 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:50.983 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:20:50.983 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:50.984 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:50.984 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:20:50.984 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:54.985 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:20:59.989 7f4d44354e10 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:20:59.989 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:20:59.989 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:59.989 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:20:59.989 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:59.989 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:20:59.990 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:20:59.990 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:59.990 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:20:59.990 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:59.990 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:59.990 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:20:59.991 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:03.991 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:21:08.996 7f4d44354e10 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:21:08.996 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:21:08.996 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:08.996 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:21:08.996 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:08.996 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:21:08.997 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:21:08.997 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:08.997 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:21:08.997 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:08.997 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:08.997 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:21:08.997 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:10.366 7f4d44354e10 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbqWvkyQ1KuciqRkBlfNcjQilC1eYpkq9lEXR1cdoKIvDpPuH1MAbDbDrkWazQMLV-VZixQZk5lhCAnWwEYUY281GYPC9ooL7qxnOUPdRaVzsU0qF4B3glUwBhDLKJvB9XHhsL3pHXh9dytk59y2aGnyyxXbWo6JrDf4ylNlqRTml20 10/21/2024 02:21:10.366 7f4d44354e10 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:21:10.367 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 578 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:21:10.835 7f4d44354e10 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbqWWGxxiW2_u22ZiW3NBvMC-HIJgFI689q3auT_YbunNrsbyD-839LqxjM7SuiFnkjoQfIJUBc3Wp0k04NrPVA4VKAs3zLfTsS3CXrRI8gFmaWZiTFAfYPb8djlE6NpoyYxTRKCSf96ojIe1f1TDC8auEcskR0Yy51-GzBHhwRl32g 10/21/2024 02:21:10.835 7f4d44354e10 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:21:10.835 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 526 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:21:12.997 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:21:18.001 7f4d44354e10 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:21:18.002 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:21:18.002 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:18.002 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:21:18.002 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:18.002 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:21:18.003 7f4d44354e10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:21:18.003 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:18.003 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:21:18.004 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:18.004 7f4d44354e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:18.004 7f4d44354e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:21:18.004 7f4d44354e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:20.174 7f4d44354e10 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:21:20.271 7f4d3bfc7f60 [contrail-analytics-api] [DEBUG]: resource list for database-node is None 10/21/2024 02:21:20.273 7f4d40d05240 [contrail-analytics-api] [INFO]: db usage:{} 10/21/2024 02:21:20.277 7f4d3bfc7f60 [contrail-analytics-api] [DEBUG]: resource list for database-node is None 10/21/2024 02:21:20.278 7f4d40d05240 [contrail-analytics-api] [INFO]: pending compaction tasks :{} 10/21/2024 02:21:22.003 7f4d402048d0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:21:27.005 7f4d402048d0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:21:27.006 7f4d402048d0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:21:27.006 7f4d402048d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:27.006 7f4d402048d0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:21:27.006 7f4d402048d0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:27.006 7f4d402048d0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:21:27.007 7f4d402048d0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:21:27.007 7f4d402048d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:27.007 7f4d402048d0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:21:27.008 7f4d402048d0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:27.008 7f4d402048d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:27.008 7f4d402048d0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:21:27.008 7f4d402048d0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:31.006 7f4d402048d0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:21:36.009 7f4d402048d0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:21:36.009 7f4d402048d0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:21:36.009 7f4d402048d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:36.009 7f4d402048d0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:21:36.009 7f4d402048d0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:36.009 7f4d402048d0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:21:36.010 7f4d402048d0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:21:36.010 7f4d402048d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:36.010 7f4d402048d0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:21:36.010 7f4d402048d0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:36.010 7f4d402048d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:36.010 7f4d402048d0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:21:36.010 7f4d402048d0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:40.012 7f4d402048d0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:21:45.017 7f4d402048d0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:21:45.017 7f4d402048d0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:21:45.017 7f4d402048d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:45.017 7f4d402048d0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:21:45.017 7f4d402048d0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:45.018 7f4d402048d0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:21:45.018 7f4d402048d0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:21:45.018 7f4d402048d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:45.018 7f4d402048d0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:21:45.018 7f4d402048d0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:45.018 7f4d402048d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:45.019 7f4d402048d0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:21:45.019 7f4d402048d0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:49.021 7f4d402048d0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:21:54.025 7f4d402048d0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:21:54.025 7f4d402048d0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:21:54.025 7f4d402048d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:54.025 7f4d402048d0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:21:54.025 7f4d402048d0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:54.026 7f4d402048d0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:21:54.026 7f4d402048d0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:21:54.026 7f4d402048d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:54.026 7f4d402048d0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:21:54.026 7f4d402048d0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:54.026 7f4d402048d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:54.027 7f4d402048d0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:21:54.027 7f4d402048d0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:58.027 7f4d402048d0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:22:03.031 7f4d402048d0 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:22:03.031 7f4d402048d0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:22:03.031 7f4d402048d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:03.031 7f4d402048d0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:22:03.031 7f4d402048d0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:03.031 7f4d402048d0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:22:03.032 7f4d402048d0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:22:03.032 7f4d402048d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:03.032 7f4d402048d0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:22:03.032 7f4d402048d0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:03.032 7f4d402048d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:03.033 7f4d402048d0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:22:03.033 7f4d402048d0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:05.459 7f4d402048d0 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 10/21/2024 02:22:06.619 7f4d43c9aa20 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 10/21/2024 02:22:07.031 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:22:11.322 7f4d3bfef828 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbrTo_-wY-PKzSaz8mm-Pnsrpb7OOoEsPFbQIa3NUBhmdm2OXDCjgleukCDYMxXHnZmrdvo3Vkzx9HgXGIUGOXf7p3SARM0gq0ASvoMh65iFlXMA0DMvMIqYdoX4Kj6wqDoJREBhDlWnLEo2SKj6cENmp1FwzZq_AoqiKMmB-30UVCI 10/21/2024 02:22:11.322 7f4d3bfef828 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:22:11.323 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 561 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:22:11.323 7f4d40156630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 561 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:22:11.793 7f4d3bfef828 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbrTmUismmkFDmOI6-tMlL4E8vc72OtzRnsRY5cpds9Mmb5QGa9n6-jniA6F5MsgcXLoMYxAF76e2ISWMWiuiu9k570z4Z2VeDicUaNmcab1DfCwdvMs7vrk98mLZoB6hiRBHyT6DCCsDjTo4RjMTadzLmmK3MSkGcsl3F1mS1exaE8 10/21/2024 02:22:11.793 7f4d3bfef828 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:22:11.794 7f4d3bfc7eb8 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 547 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:22:11.794 7f4d3bfc7eb8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 547 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:22:12.034 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:22:12.034 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:22:12.034 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:12.035 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:22:12.035 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:12.035 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:22:12.035 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:22:12.036 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:12.036 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:22:12.036 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:12.036 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:12.036 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:22:12.036 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:16.035 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:22:21.037 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:22:21.037 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:22:21.038 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:21.038 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:22:21.038 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:21.038 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:22:21.038 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:22:21.038 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:21.039 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:22:21.039 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:21.039 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:21.039 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:22:21.039 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:25.041 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:22:30.047 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:22:30.047 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:22:30.047 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:30.048 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:22:30.048 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:30.048 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:22:30.048 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:22:30.048 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:30.048 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:22:30.049 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:30.049 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:30.049 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:22:30.049 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:34.047 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:22:39.052 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:22:39.052 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:22:39.053 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:39.053 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:22:39.053 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:39.053 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:22:39.053 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:22:39.053 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:39.054 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:22:39.054 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:39.054 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:39.054 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:22:39.054 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:43.055 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:22:48.057 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:22:48.058 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:22:48.058 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:48.058 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:22:48.058 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:48.058 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:22:48.059 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:22:48.059 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:48.059 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:22:48.059 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:48.059 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:48.059 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:22:48.059 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:52.059 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:22:57.063 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:22:57.063 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:22:57.063 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:57.063 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:22:57.064 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:57.064 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:22:57.064 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:22:57.064 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:57.064 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:22:57.064 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:57.064 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:57.065 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:22:57.065 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:57.236 7f4d43c9aa20 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:23:01.063 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:23:06.065 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:23:06.065 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:23:06.065 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:06.066 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:23:06.066 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:06.066 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:23:06.066 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:23:06.066 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:06.066 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:23:06.067 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:06.067 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:06.067 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:23:06.067 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:10.069 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:23:10.949 7f4d40204c18 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:23:12.305 7f4d40204c18 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbsQDHDbleReD64PvIi5n4qm3HFSLpbBP419cEZblIARGD50gTiK6NMcAaycaqFZb2JnthJfgdcURvk_gGm-Sd6Y7U3Z4D1z2CjcPX_OShGmQtMnr7s3XKHdePJxoACqgpAUOpqC9lmEP97Dy7A-S_p2VmtFhgxnjFk39W2avBH3Huo 10/21/2024 02:23:12.305 7f4d40204c18 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:23:12.306 7f4d3bfe7630 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 562 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:23:12.306 7f4d3bfe7630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 562 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:23:12.780 7f4d40204c18 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbsQW0D0J6XZHqVmAu0bdsX6jiVI-hk6jhyjv19ATy0tvZAsrKD3J2f54g9W_blk20F0ia-STdUjb2jWGUKyfkVGuuURslGv9qQqQcjE2omR1QYWtcDg9IdPqTUZ8FX9Wynigo8nZG8brAoZ69qa3mB_Jby-ZtS1UhISPG-aQu8Z7Wg 10/21/2024 02:23:12.780 7f4d40204c18 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:23:12.781 7f4d40218438 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 604 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:23:12.781 7f4d40218438 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 604 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:23:15.072 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:23:15.072 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:23:15.072 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:15.072 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:23:15.073 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:15.073 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:23:15.073 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:23:15.073 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:15.073 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:23:15.073 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:15.074 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:15.074 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:23:15.074 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:19.076 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:23:24.110 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:23:24.111 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:23:24.111 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:24.111 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:23:24.111 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:24.111 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:23:24.112 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:23:24.112 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:24.112 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:23:24.113 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:24.113 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:24.113 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:23:24.113 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:28.111 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:23:33.115 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:23:33.115 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:23:33.115 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:33.116 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:23:33.116 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:33.116 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:23:33.116 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:23:33.116 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:33.117 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:23:33.117 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:33.117 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:33.117 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:23:33.117 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:34.799 7f4d43c9aa20 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:23:37.116 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:23:42.120 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:23:42.120 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:23:42.120 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:42.120 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:23:42.120 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:42.120 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:23:42.121 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:23:42.121 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:42.121 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:23:42.121 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:42.121 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:42.121 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:23:42.122 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:46.120 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:23:51.123 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:23:51.123 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:23:51.123 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:51.123 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:23:51.123 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:51.124 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:23:51.124 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:23:51.124 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:51.124 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:23:51.124 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:51.124 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:51.125 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:23:51.125 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:55.125 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:24:00.131 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:24:00.131 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:24:00.131 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:00.132 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:24:00.132 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:00.132 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:24:00.132 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:24:00.132 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:00.133 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:24:00.133 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:00.133 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:00.133 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:24:00.133 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:04.135 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:24:09.140 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:24:09.140 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:24:09.140 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:09.140 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:24:09.140 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:09.140 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:24:09.141 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:24:09.141 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:09.141 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:24:09.141 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:09.141 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:09.142 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:24:09.142 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:13.142 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:24:13.268 7f4d401ef6d8 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbtNq1ldJiEsSvvKXRJqU0C9hTea6-jrP3tYlezFgYfa-xKP5RDeS4ViLlWA6b7FLagXtD8sInmg4yk0nsh8LJTMyA0QRc2h7DT3BRUEauxfopJ-4WxajmXAwvBfxFnK9TvShNb9eJs2MF35EH86EqlvMr8m9HUfbFpF8KU_uzoQ3eE 10/21/2024 02:24:13.268 7f4d401ef6d8 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:24:13.268 7f4d3bfcc8d0 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 537 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:24:13.269 7f4d3bfcc8d0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 537 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:24:13.743 7f4d401ef6d8 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbtNl9HUP7KUwVHGKlhpkg7eEJSTQ1a3YMZ28dMeE81bpJfSxr2Yz30jwYNYuIykyqgvNIIe6ORs-4qQTHmcGzRD6b0vetmjJ-_h97BHtDjXfq0S8c1A10tyREerU_5wauOA5iJ8hdD-Q74NzUMGwEJm7pq4JL6OpoSR37rQcCg2uZM 10/21/2024 02:24:13.743 7f4d401ef6d8 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:24:13.744 7f4d3bfcb4e0 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 557 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:24:13.744 7f4d3bfcb4e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 557 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:24:18.145 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:24:18.146 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:24:18.146 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:18.146 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:24:18.146 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:18.146 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:24:18.147 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:24:18.147 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:18.147 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:24:18.147 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:18.147 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:18.147 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:24:18.147 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:22.147 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:24:27.149 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:24:27.150 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:24:27.150 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:27.150 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:24:27.150 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:27.151 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:24:27.151 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:24:27.151 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:27.152 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:24:27.152 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:27.152 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:27.152 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:24:27.152 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:31.150 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:24:36.153 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:24:36.153 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:24:36.153 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:36.153 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:24:36.153 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:36.154 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:24:36.154 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:24:36.154 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:36.155 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:24:36.155 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:36.155 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:36.155 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:24:36.155 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:40.156 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:24:45.159 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:24:45.159 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:24:45.159 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:45.159 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:24:45.159 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:45.159 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:24:45.160 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:24:45.160 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:45.160 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:24:45.160 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:45.160 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:45.160 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:24:45.161 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:49.161 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:24:54.166 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:24:54.166 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:24:54.166 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:54.166 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:24:54.166 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:54.166 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:24:54.167 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:24:54.167 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:54.167 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:24:54.167 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:54.167 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:54.167 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:24:54.167 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:58.167 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:25:03.171 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:25:03.171 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:25:03.172 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:03.172 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:25:03.172 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:03.172 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:25:03.173 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:25:03.173 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:03.174 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:25:03.174 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:03.174 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:03.175 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:25:03.175 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:07.172 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:25:12.174 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:25:12.174 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:25:12.174 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:12.175 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:25:12.175 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:12.175 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:25:12.175 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:25:12.175 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:12.175 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:25:12.176 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:12.176 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:12.176 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:25:12.176 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:14.265 7f4d43c9aa20 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbuKf1QcTJt8qggg6PeLLMsY0lwTJxDDu6WKIsKlt3ZrC34bSS3Vji5AgofO07xc3Ei-06PvcE7P6JaHgG0g5iEvppla21pikR-BOU1BKtftJT9ia_xM7JE9-LMYmcqB8-d2631qVWuS6tKSq0b6KAS-8aRJCQpHSZi-G6ivKU0jbrU 10/21/2024 02:25:14.265 7f4d43c9aa20 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:25:14.266 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 564 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:25:14.739 7f4d43c9aa20 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbuK0p1VlFMSpkCfHW2ClPk4m4D-ykP2CtkEir_7OLr6Q8cY-oev04HH9eOHp68J2xc1HAKyEMbMqGWuagjR3gJhoLct1LTiPDWe9xgm0p2cIA8XSCr5z3b0_HFPyN4faMuLqQcaejhGR37CMQIB54XATqCv5PPK4-MIqVf8R_vxGYg 10/21/2024 02:25:14.739 7f4d43c9aa20 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:25:14.740 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 534 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:25:16.175 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:25:21.177 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:25:21.177 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:25:21.177 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:21.178 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:25:21.178 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:21.178 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:25:21.178 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:25:21.178 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:21.178 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:25:21.179 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:21.179 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:21.179 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:25:21.179 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:25.179 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:25:30.185 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:25:30.185 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:25:30.185 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:30.186 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:25:30.186 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:30.186 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:25:30.187 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:25:30.187 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:30.187 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:25:30.190 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:30.190 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:30.190 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:25:30.190 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:34.188 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:25:39.191 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:25:39.192 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:25:39.192 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:39.192 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:25:39.192 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:39.192 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:25:39.193 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:25:39.193 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:39.193 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:25:39.193 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:39.193 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:39.193 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:25:39.193 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:43.193 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:25:48.195 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:25:48.196 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:25:48.196 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:48.196 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:25:48.196 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:48.196 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:25:48.197 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:25:48.197 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:48.197 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:25:48.197 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:48.197 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:48.197 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:25:48.197 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:52.197 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:25:57.200 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:25:57.200 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:25:57.200 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:57.200 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:25:57.200 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:57.201 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:25:57.201 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:25:57.201 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:57.201 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:25:57.201 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:57.201 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:57.201 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:25:57.202 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:01.200 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:26:06.203 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:26:06.203 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:26:06.203 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:06.203 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:26:06.203 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:06.203 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:26:06.204 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:26:06.204 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:06.204 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:26:06.204 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:06.204 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:06.204 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:26:06.204 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:10.207 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:26:15.209 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:26:15.209 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:26:15.210 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:15.210 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:26:15.210 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:15.210 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:26:15.211 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:26:15.211 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:15.211 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:26:15.211 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:15.212 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:15.212 7f4d43c9aa20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:26:15.212 7f4d43c9aa20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:15.239 7f4d3bfcbc18 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbvH1iitb1tnCrncPvKTFQ8iD_8K8kySHHdLAwa2gao1b5dfw2EYj8eyocFOwfkaxPMKAvcMqKcvHWiooNnVt1VC8dL7xMzASiLfF-ly8YWasg6jv-_dh7U_yGnaSmjHv72PRlcQh4bvrnP3OeVI72rdiIDtfBUFS2QQZaGDOHAnX5w 10/21/2024 02:26:15.240 7f4d3bfcbc18 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:26:15.241 7f4d3bfcbc18 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 1646 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:26:15.711 7f4d3bfcbc18 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbvHJ3s0jEEPooeomD0zj8T4rehtRg0eIhrazDCFH7y7ZwlpOh1QzAxjl40Rf8IIz5X5aQD-62D67EtIfC8A1ZpsfYkilPnGeDas-zI9k7He_SPabI6vPCWX-70WFCYelpbiXe0Bt6Ho3mhh_sB1UxWVIsy-3OOD5yM_nciX_4dXWVI 10/21/2024 02:26:15.712 7f4d3bfcbc18 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:26:15.712 7f4d3bfcbc18 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 529 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:26:19.212 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:26:24.217 7f4d3bfcbc18 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:26:24.217 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:26:24.218 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:24.218 7f4d3bfcbc18 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:26:24.218 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:24.218 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:26:24.218 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:26:24.218 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:24.219 7f4d3bfcbc18 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:26:24.219 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:24.219 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:24.219 7f4d3bfcbc18 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:26:24.219 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:28.220 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:26:33.224 7f4d3bfcbc18 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:26:33.224 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:26:33.224 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:33.224 7f4d3bfcbc18 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:26:33.224 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:33.225 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:26:33.225 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:26:33.225 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:33.225 7f4d3bfcbc18 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:26:33.225 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:33.225 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:33.226 7f4d3bfcbc18 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:26:33.226 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:37.225 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:26:42.227 7f4d3bfcbc18 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:26:42.228 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:26:42.228 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:42.228 7f4d3bfcbc18 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:26:42.228 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:42.228 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:26:42.229 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:26:42.229 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:42.229 7f4d3bfcbc18 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:26:42.229 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:42.229 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:42.229 7f4d3bfcbc18 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:26:42.229 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:46.228 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:26:51.230 7f4d3bfcbc18 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:26:51.231 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:26:51.231 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:51.231 7f4d3bfcbc18 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:26:51.231 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:51.231 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:26:51.232 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:26:51.232 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:51.232 7f4d3bfcbc18 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:26:51.232 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:51.232 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:51.232 7f4d3bfcbc18 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:26:51.232 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:55.233 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:27:00.239 7f4d3bfcbc18 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:27:00.240 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:27:00.240 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:00.240 7f4d3bfcbc18 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:27:00.240 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:00.240 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:27:00.241 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:27:00.241 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:00.241 7f4d3bfcbc18 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:27:00.241 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:00.241 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:00.241 7f4d3bfcbc18 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:27:00.241 7f4d3bfcbc18 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:04.242 7f4d402cceb8 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:27:05.480 7f4d3bfefa20 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 10/21/2024 02:27:06.625 7f4d3bfefa20 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 10/21/2024 02:27:09.245 7f4d402cceb8 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:27:09.245 7f4d402cceb8 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:27:09.246 7f4d402cceb8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:09.246 7f4d402cceb8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:27:09.246 7f4d402cceb8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:09.246 7f4d402cceb8 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:27:09.246 7f4d402cceb8 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:27:09.246 7f4d402cceb8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:09.247 7f4d402cceb8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:27:09.247 7f4d402cceb8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:09.247 7f4d402cceb8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:09.247 7f4d402cceb8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:27:09.247 7f4d402cceb8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:12.918 7f4d402cceb8 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:27:13.246 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:27:16.215 7f4d402ccf60 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbwEVoTMSkULBsqAjJCsseEoPGbzpEK8cAZoUJj8NOjc7U5bK3eDiAU6RLGvuhA0pS0-gz3ewptjPkABtog7O2Qej6P9IcqgepNF72mfjQe4L17P43CtfNw6O5XOZDL3noWw8mYo0oOUxdw9yb3S6ndp8s1rY9gZMe_V5Q7UNH9ZfGE 10/21/2024 02:27:16.216 7f4d402ccf60 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:27:16.216 7f4d3bfe7588 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 540 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:27:16.217 7f4d3bfe7588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 540 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:27:16.690 7f4d402ccf60 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbwEl1PJ9gPd2mIfxwd6hOirjWELCMrDWe3XlRqkvnTSMWHay0ajtuv84OwRNNunSrIfBUlQ0gQe5z0Uec7LQBfHTJNXQGDGxF9yMGYN1k7tmJB-nDfOc0RULUjl2DfZ18u8y3LMWGIxEjxGg-zQiS-BnU4YHEBTK0ouWITGiBSH7lc 10/21/2024 02:27:16.690 7f4d402ccf60 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:27:16.691 7f4d3bfc78d0 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 588 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:27:16.691 7f4d3bfc78d0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 588 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:27:18.249 7f4d3bfcb390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:27:18.262 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:27:18.262 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:18.262 7f4d3bfcb390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:27:18.262 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:18.262 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:27:18.263 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:27:18.263 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:18.263 7f4d3bfcb390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:27:18.263 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:18.263 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:18.263 7f4d3bfcb390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:27:18.263 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:22.249 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:27:27.252 7f4d3bfcb390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:27:27.253 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:27:27.253 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:27.253 7f4d3bfcb390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:27:27.253 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:27.254 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:27:27.254 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:27:27.254 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:27.255 7f4d3bfcb390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:27:27.255 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:27.255 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:27.255 7f4d3bfcb390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:27:27.255 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:31.253 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:27:36.258 7f4d3bfcb390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:27:36.258 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:27:36.258 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:36.258 7f4d3bfcb390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:27:36.258 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:36.258 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:27:36.259 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:27:36.259 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:36.259 7f4d3bfcb390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:27:36.259 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:36.259 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:36.260 7f4d3bfcb390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:27:36.260 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:40.261 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:27:45.265 7f4d3bfcb390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:27:45.266 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:27:45.266 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:45.266 7f4d3bfcb390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:27:45.266 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:45.266 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:27:45.267 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:27:45.267 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:45.267 7f4d3bfcb390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:27:45.267 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:45.267 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:45.267 7f4d3bfcb390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:27:45.267 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:49.267 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:27:50.645 7f4d402040f0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:27:54.271 7f4d3bfcb390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:27:54.271 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:27:54.271 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:54.272 7f4d3bfcb390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:27:54.272 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:54.272 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:27:54.272 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:27:54.272 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:54.273 7f4d3bfcb390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:27:54.273 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:54.273 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:54.273 7f4d3bfcb390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:27:54.273 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:58.273 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:28:03.277 7f4d3bfcb390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:28:03.277 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:28:03.277 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:03.278 7f4d3bfcb390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:28:03.278 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:03.278 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:28:03.279 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:28:03.279 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:03.279 7f4d3bfcb390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:28:03.279 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:03.279 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:03.279 7f4d3bfcb390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:28:03.280 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:04.484 7f4d3bfcb390 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:28:07.279 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:28:12.283 7f4d3bfcb390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:28:12.284 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:28:12.284 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:12.284 7f4d3bfcb390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:28:12.284 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:12.284 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:28:12.285 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:28:12.285 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:12.285 7f4d3bfcb390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:28:12.285 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:12.285 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:12.285 7f4d3bfcb390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:28:12.286 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:16.284 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:28:17.222 7f4d3bfe8198 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbxB8X1nC1JG0bs7Zt5IG-P8eiEko7il-aj2gFFE1n41AnIlVQLTx64R_ZjIOeRs7h9i1qHrRbtEOapr51FU9wOQO5xbFbPMoCFCz-oEP-WzKXr3EIp4L-VuSLKzITcJXIKHKcibK1Qb7uKh8Q1JOVSM92KdCaVZLlNfqggzeNRWXoQ 10/21/2024 02:28:17.222 7f4d3bfe8198 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:28:17.223 7f4d40218240 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 788 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:28:17.223 7f4d40218240 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 788 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:28:17.690 7f4d3bfe8198 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbxBgHpnDCLC3f-aBfYLiVlyPtxfkWzcjXqDghDs5Q8O1dRHc8kGM6k2H-3PZs1R5PgOYig-RttSlf8rOU7-wukX4CvGjpJb1NtWFTPMiWG6QM2rD-IEujIXk-y_adX90J9nYZkYRKpTTlVk0dyhi_RqJRmPZTqGsk7QAHMzWGFcj-w 10/21/2024 02:28:17.690 7f4d3bfe8198 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:28:17.691 7f4d40218ac8 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 612 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:28:17.691 7f4d40218ac8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 612 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:28:21.287 7f4d3bfcb390 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:28:21.287 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:28:21.288 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:21.288 7f4d3bfcb390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:28:21.288 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:21.288 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:28:21.289 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:28:21.289 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:21.289 7f4d3bfcb390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:28:21.290 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:21.290 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:21.290 7f4d3bfcb390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:28:21.290 7f4d3bfcb390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:23.174 7f4d3bfe8198 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:28:25.289 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:28:30.293 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:28:30.293 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:28:30.293 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:30.293 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:28:30.293 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:30.294 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:28:30.294 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:28:30.294 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:30.294 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:28:30.294 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:30.294 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:30.295 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:28:30.295 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:34.294 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:28:39.299 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:28:39.300 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:28:39.300 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:39.300 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:28:39.301 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:39.301 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:28:39.301 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:28:39.302 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:39.302 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:28:39.302 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:39.302 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:39.302 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:28:39.302 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:43.301 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:28:48.306 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:28:48.306 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:28:48.306 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:48.306 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:28:48.306 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:48.306 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:28:48.307 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:28:48.307 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:48.307 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:28:48.307 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:48.307 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:48.307 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:28:48.307 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:52.306 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:28:57.309 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:28:57.309 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:28:57.309 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:57.310 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:28:57.310 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:57.310 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:28:57.310 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:28:57.311 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:57.311 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:28:57.311 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:57.311 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:57.311 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:28:57.311 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:01.309 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:29:06.312 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:29:06.312 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:29:06.312 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:06.312 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:29:06.312 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:06.313 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:29:06.313 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:29:06.313 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:06.313 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:29:06.313 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:06.313 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:06.314 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:29:06.314 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:10.315 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:29:15.321 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:29:15.321 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:29:15.322 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:15.322 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:29:15.322 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:15.322 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:29:15.323 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:29:15.323 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:15.323 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:29:15.323 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:15.323 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:15.323 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:29:15.323 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:18.198 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbx-bG28vNtHNNHqa_snpspzXjq6Swajiqh42-XjOf9fQWK6dQ4gxkxiLMJ_wArUTICs1qElEUBf2wca-OUxpb-BVfyPzQ4XeNCsMODOIA7SNUUaB8ZmVonwqyOwpTtSVyED3_bVrF5zr9AAGERIkJZ2BeYKCzCj2dxKnXnu4TTem_A 10/21/2024 02:29:18.198 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:29:18.199 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 540 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:29:18.699 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbx-Up7jgAfEP0w9S85VOtpGfjAx-EAbmPdPt73dhBsAwpwVQiCYfMlo_M225JciMwqlvi3An9CiRvEYoRbBlF163Jly8flDj4L_sfIJUyFaySzW2qfDRx4eGFcpsQGJ_oR06X1i8zljJsMCL9qRvzBM-A-_4Itr1AuMqUbyMHs4Djs 10/21/2024 02:29:18.700 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:29:18.700 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 563 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:29:19.322 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:29:24.325 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:29:24.325 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:29:24.325 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:24.325 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:29:24.325 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:24.326 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:29:24.326 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:29:24.326 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:24.326 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:29:24.326 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:24.326 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:24.327 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:29:24.327 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:28.328 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:29:33.332 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:29:33.333 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:29:33.333 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:33.333 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:29:33.333 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:33.333 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:29:33.333 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:29:33.334 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:33.334 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:29:33.334 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:33.334 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:33.334 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:29:33.334 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:37.333 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:29:42.337 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:29:42.337 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:29:42.337 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:42.337 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:29:42.337 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:42.337 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:29:42.338 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:29:42.338 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:42.338 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:29:42.338 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:42.338 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:42.338 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:29:42.338 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:46.337 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:29:51.339 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:29:51.340 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:29:51.340 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:51.340 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:29:51.340 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:51.340 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:29:51.341 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:29:51.341 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:51.341 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:29:51.341 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:51.341 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:51.341 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:29:51.341 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:55.343 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:30:00.345 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:30:00.345 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:30:00.345 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:00.346 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:30:00.346 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:00.346 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:30:00.346 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:30:00.346 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:00.347 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:30:00.347 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:00.347 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:00.347 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:30:00.347 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:04.348 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:30:09.353 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:30:09.353 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:30:09.353 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:09.353 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:30:09.353 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:09.353 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:30:09.354 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:30:09.354 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:09.354 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:30:09.354 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:09.354 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:09.354 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:30:09.355 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:13.353 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:30:18.357 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:30:18.357 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:30:18.357 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:18.358 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:30:18.358 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:18.358 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:30:18.358 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:30:18.358 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:18.358 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:30:18.358 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:18.359 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:18.359 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:30:18.359 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:19.216 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFby75RPcDRi2zI1b6AVqK7rTV59obb2Yu1sbXtz4lbL2LzYqHk9uKNK6B1pqDc0dSwsiGNYMobit27qPhAKHl7pD414P0lpkrkAgH2CQRs7KdTYCZO2mLNEjVy-neTLwvey08WSvjiOyxgKY58bShcXRxlllS6jKbmmX-MNA2Vrws4Q 10/21/2024 02:30:19.216 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:30:19.216 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 592 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:30:19.676 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFby71JrGvOpoQZea4YN5WD2IwtDOXEu44EL_tGAetyG6eWqnHiJp5vEKlVAKwFOcv8yCSB6H60V3Ny5fBSNFF8M0QSViEf6_SkNoKPfgRrE0qVS1nowyX7rc-T9b9h5h_-siJrRPSXCKM3tzmocigT7aqhBzh3PtiFSSmetqcqI6I2M 10/21/2024 02:30:19.676 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:30:19.677 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 852 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:30:22.359 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:30:27.362 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:30:27.362 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:30:27.362 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:27.362 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:30:27.363 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:27.363 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:30:27.363 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:30:27.363 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:27.364 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:30:27.364 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:27.364 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:27.364 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:30:27.364 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:31.362 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:30:36.365 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:30:36.365 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:30:36.365 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:36.365 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:30:36.365 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:36.365 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:30:36.366 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:30:36.366 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:36.366 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:30:36.366 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:36.366 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:36.366 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:30:36.366 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:40.365 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:30:45.369 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:30:45.369 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:30:45.369 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:45.369 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:30:45.369 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:45.369 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:30:45.370 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:30:45.370 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:45.370 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:30:45.370 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:45.370 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:45.370 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:30:45.371 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:49.373 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:30:54.376 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:30:54.376 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:30:54.376 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:54.376 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:30:54.376 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:54.376 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:30:54.377 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:30:54.377 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:54.377 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:30:54.377 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:54.377 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:54.377 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:30:54.378 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:58.379 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:31:03.383 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:31:03.383 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:31:03.383 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:03.384 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:31:03.384 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:03.384 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:31:03.384 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:31:03.385 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:03.385 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:31:03.385 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:03.385 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:03.385 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:31:03.385 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:07.384 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:31:12.386 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:31:12.387 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:31:12.387 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:12.387 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:31:12.387 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:12.387 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:31:12.388 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:31:12.388 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:12.389 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:31:12.389 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:12.389 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:12.389 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:31:12.389 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:16.387 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:31:20.263 7f4d40218cc0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbz49_JuaZ0yPMVrcZ-eyF7qFJ687IbWbge7RklhgnZmRaQFuWXERapJLmwQf5_DzrmfhcM-HahQtzYjl_F8GwFq9soVHrS-x0vZVyp57_tcNREzwp0gKKn5ZacRwnVXsMX31BX3AYFBhDzlFHWbQYX631Obr1OJUQUNSIYAhkSAvKU 10/21/2024 02:31:20.263 7f4d40218cc0 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:31:20.264 7f4d3bfe7438 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 634 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:31:20.264 7f4d3bfe7438 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 634 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:31:20.285 7f4d401fb048 [contrail-analytics-api] [DEBUG]: resource list for database-node is None 10/21/2024 02:31:20.286 7f4d40d05240 [contrail-analytics-api] [INFO]: db usage:{} 10/21/2024 02:31:20.292 7f4d3bfd0048 [contrail-analytics-api] [DEBUG]: resource list for database-node is None 10/21/2024 02:31:20.293 7f4d40d05240 [contrail-analytics-api] [INFO]: pending compaction tasks :{} 10/21/2024 02:31:20.722 7f4d3bfcc780 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFbz4dBVhtpppwjKb6AbVnwntGzjU45McoXr1Lf8dza1C1nYoaw8y0n0tIHBTcWrWHt85Y96MSC3hwD1CwgHsk8BbWG3ut3M5kACRdVLTQPSG65leDjiMYgJDa4VvukliKXPtnqt7SgF3eGkXBpHhyXS2lyMVazua5JYE4ln4OZsvcBI 10/21/2024 02:31:20.722 7f4d3bfcc780 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:31:20.723 7f4d3bfcceb8 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 557 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:31:20.723 7f4d3bfcceb8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 557 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:31:21.389 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:31:21.390 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:31:21.390 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:21.390 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:31:21.390 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:21.390 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:31:21.391 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:31:21.391 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:21.391 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:31:21.391 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:21.391 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:21.391 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:31:21.391 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:25.393 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:31:30.399 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:31:30.399 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:31:30.400 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:30.400 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:31:30.400 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:30.400 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:31:30.400 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:31:30.401 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:30.401 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:31:30.401 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:30.401 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:30.401 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:31:30.401 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:34.401 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:31:39.405 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:31:39.405 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:31:39.406 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:39.406 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:31:39.406 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:39.406 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:31:39.406 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:31:39.406 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:39.407 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:31:39.407 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:39.407 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:39.407 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:31:39.407 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:43.407 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:31:48.411 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:31:48.411 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:31:48.411 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:48.412 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:31:48.412 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:48.412 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:31:48.412 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:31:48.412 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:48.413 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:31:48.413 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:48.413 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:48.413 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:31:48.413 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:50.119 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:31:52.412 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:31:57.414 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:31:57.415 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:31:57.415 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:57.415 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:31:57.415 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:57.415 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:31:57.416 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:31:57.416 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:57.416 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:31:57.416 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:57.416 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:57.417 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:31:57.417 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:01.415 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:32:05.465 7f4d401fb588 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 10/21/2024 02:32:06.417 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:32:06.417 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:32:06.417 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:06.418 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:32:06.418 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:06.418 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:32:06.418 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:32:06.419 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:06.419 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:32:06.419 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:06.419 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:06.419 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:32:06.419 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:06.615 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 10/21/2024 02:32:10.421 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:32:15.425 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:32:15.425 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:32:15.425 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:15.425 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:32:15.425 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:15.425 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:32:15.426 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:32:15.426 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:15.426 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:32:15.426 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:15.426 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:15.426 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:32:15.426 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:19.429 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:32:21.265 7f4d40218cc0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFb01D36YMFVPlOsNxdHVG_LlkOutfHbkr2-BnOrSYusn44wn8Vqbo59nb7331hYjm-JgC-MmBTte9pK4CyGBHpC1l7tpu-sJswJi-u6Y3fG_P2YpUoXLl0OeIgn9xwWK2VGpgJ5eHLnVhA4Oi_T_WYmiT0ifxuqVvP9oc-hGt4ut0VA 10/21/2024 02:32:21.265 7f4d40218cc0 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:32:21.266 7f4d3bfcb630 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 566 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:32:21.266 7f4d3bfcb630 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 566 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:32:21.729 7f4d40218cc0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFb01qcEED2ySiH_xlYp-2XYd4zniNihEBP9NQhCsd-XArLRRNVrb9H8EbYPeumYQx7kG2F0Q750xyec1T9HyoGY-YOwmlfvkpYCWw4iB3Y3hX8uVRdKjXrGLfZTHWwCkW7CmYoAMZ54nggb6PkRi_ss4IK1yjlEIvZcUXUMQaZLSarU 10/21/2024 02:32:21.729 7f4d40218cc0 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:32:21.730 7f4d3bfdfe10 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 565 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:32:21.730 7f4d3bfdfe10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 565 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:32:24.431 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:32:24.431 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:32:24.431 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:24.432 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:32:24.432 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:24.432 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:32:24.432 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:32:24.432 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:24.433 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:32:24.433 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:24.433 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:24.433 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:32:24.433 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:28.434 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:32:31.750 7f4d401f4c18 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:32:33.437 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:32:33.438 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:32:33.438 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:33.438 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:32:33.438 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:33.438 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:32:33.439 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:32:33.439 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:33.439 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:32:33.439 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:33.439 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:33.439 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:32:33.439 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:37.438 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:32:42.441 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:32:42.442 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:32:42.442 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:42.442 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:32:42.442 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:42.442 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:32:42.443 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:32:42.443 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:42.443 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:32:42.443 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:42.443 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:42.443 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:32:42.443 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:45.725 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:32:46.442 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:32:51.443 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:32:51.444 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:32:51.444 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:51.444 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:32:51.444 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:51.444 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:32:51.445 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:32:51.445 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:51.445 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:32:51.445 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:51.445 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:51.445 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:32:51.445 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:55.447 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:33:00.453 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:33:00.453 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:33:00.453 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:00.454 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:33:00.454 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:00.454 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:33:00.454 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:33:00.454 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:00.455 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:33:00.455 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:00.455 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:00.455 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:33:00.455 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:02.717 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:33:04.453 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:33:09.458 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:33:09.459 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:33:09.459 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:09.459 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:33:09.459 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:09.459 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:33:09.460 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:33:09.460 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:09.460 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:33:09.461 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:09.461 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:09.461 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:33:09.461 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:13.461 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:33:18.465 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:33:18.465 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:33:18.465 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:18.465 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:33:18.465 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:18.465 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:33:18.466 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:33:18.466 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:18.466 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:33:18.466 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:18.466 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:18.466 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:33:18.466 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:22.242 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFb1yHxY-0unX3ExMGiFdPXF7rVmilLfGMzYMWjemmdTZAlUynBC2opIUSW8qt4e8jgR1Iguv7nkDF6Wl7Ld5Ob9UsFzPNCNb9xKhbGfF-o-QZZJCeRq0SSPigLaL59liBk2COqtJluvQEBWXlpcU9acNDcphV_o49GohpODijhxh6Ys 10/21/2024 02:33:22.242 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:33:22.242 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 540 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:33:22.465 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:33:22.708 7f4d401ef978 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFb1yHWBnuAxnR5-8f90ejtb5X9q7j4ZQOg4mVEH3AwzNu0qG-Cl_A_FgT1cl1M8ifYwGEO-9yN6Q1mZQQ-5tYcgJjXJGUhhqiajXVhuTs8Z7qbWhB_P03ycgXXgH5exGgnAdAm66-_9VkrHd7CNkez9Xsr2zNzMx8rpSGZ0C2et8MmY 10/21/2024 02:33:22.708 7f4d401ef978 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:33:22.709 7f4d3bfc78d0 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 578 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:33:22.709 7f4d3bfc78d0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 578 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:33:27.468 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:33:27.468 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:33:27.468 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:27.468 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:33:27.469 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:27.469 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:33:27.469 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:33:27.469 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:27.470 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:33:27.470 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:27.470 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:27.470 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:33:27.470 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:31.482 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:33:36.483 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:33:36.484 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:33:36.484 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:36.484 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:33:36.484 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:36.484 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:33:36.485 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:33:36.485 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:36.485 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:33:36.485 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:36.485 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:36.485 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:33:36.485 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:40.488 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:33:45.493 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:33:45.493 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:33:45.493 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:45.493 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:33:45.493 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:45.494 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:33:45.494 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:33:45.494 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:45.494 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:33:45.494 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:45.494 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:45.494 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:33:45.495 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:49.496 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:33:54.501 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:33:54.501 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:33:54.501 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:54.502 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:33:54.502 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:54.502 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:33:54.502 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:33:54.503 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:54.503 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:33:54.503 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:54.503 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:54.503 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:33:54.503 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:58.504 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:34:03.508 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:34:03.509 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:34:03.509 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:03.509 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:34:03.509 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:03.509 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:34:03.510 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:34:03.510 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:03.510 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:34:03.510 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:03.511 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:03.511 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:34:03.511 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:07.509 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:34:12.512 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:34:12.512 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:34:12.512 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:12.513 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:34:12.513 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:12.514 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:34:12.515 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:34:12.516 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:12.516 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:34:12.516 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:12.516 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:12.517 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:34:12.517 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:16.512 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:34:21.515 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:34:21.516 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:34:21.516 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:21.516 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:34:21.516 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:21.516 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:34:21.517 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:34:21.517 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:21.517 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:34:21.517 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:21.517 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:21.517 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:34:21.517 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:23.222 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFb2vqv3pitvCADihegAvaoJhTBKFpB6NILaFy5NmTgcG9JK8cMiMt8LaKxW5fZfrtmn3kYoc8lWJSZ1JWWw4s_zSzHfKa7t-olEKJw6JNX-URKJ6jlSSjhOYL4wkvDil4PQjysoAjx7NKwYOaNgVTJoF4i_00DbGh-OoH26WO3IAZ2M 10/21/2024 02:34:23.222 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:34:23.223 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 548 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:34:23.703 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFb2vKwByY29nVDza7RE8FgqvRIuGiYpXU7aMVhpZNiL6omaJg0Zjaqzsk9UaxSeN3CZNGqpYCuo26ra5fdc83POPmqZmBaE4Iji5hd_5USG9vVUFXlsqkTMofH3MdvWLGeCVl43nUElJSco4YacqlsuA0n7iHVwX6ymkxuGgrwKunRg 10/21/2024 02:34:23.703 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:34:23.703 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 558 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:34:25.517 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:34:30.521 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:34:30.521 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:34:30.521 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:30.521 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:34:30.521 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:30.521 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:34:30.522 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:34:30.522 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:30.522 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:34:30.522 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:30.522 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:30.522 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:34:30.522 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:34.524 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:34:39.529 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:34:39.529 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:34:39.529 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:39.530 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:34:39.530 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:39.530 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:34:39.530 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:34:39.530 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:39.530 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:34:39.531 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:39.531 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:39.531 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:34:39.531 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:43.532 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:34:48.536 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:34:48.536 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:34:48.536 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:48.536 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:34:48.536 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:48.536 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:34:48.537 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:34:48.537 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:48.537 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:34:48.537 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:48.537 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:48.537 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:34:48.537 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:52.537 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:34:57.540 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:34:57.540 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:34:57.540 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:57.541 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:34:57.541 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:57.541 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:34:57.541 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:34:57.542 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:57.542 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:34:57.542 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:57.542 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:57.542 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:34:57.542 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:01.540 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:35:06.542 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:35:06.542 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:35:06.542 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:06.543 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:35:06.543 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:06.543 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:35:06.543 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:35:06.543 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:06.543 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:35:06.544 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:06.544 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:06.544 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:35:06.544 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:10.545 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:35:15.551 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:35:15.551 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:35:15.551 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:15.552 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:35:15.552 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:15.552 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:35:15.552 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:35:15.552 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:15.553 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:35:15.553 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:15.553 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:15.553 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:35:15.553 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:19.554 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:35:24.223 7f4d402180f0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFb3sD3aZknXC00UlXpBgKv4bur8_iwnI2zhpv5e2HGQSTjyMCj5OfBPFgtuyfNtHBnAsTtkUGffx5Om8heKKjM8fksh46jOpQxHiFBZiorAOAxVfgKb6mUgmMSwk8BGmAYGVLJ9V2XgC4pa59alh-Mo3hMKTxq2MYEIvp0h1eUUhhlI 10/21/2024 02:35:24.223 7f4d402180f0 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:35:24.224 7f4d3bfefac8 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 574 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:35:24.224 7f4d3bfefac8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 574 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:35:24.556 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:35:24.557 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:35:24.557 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:24.557 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:35:24.557 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:24.557 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:35:24.558 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:35:24.558 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:24.558 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:35:24.558 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:24.558 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:24.558 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:35:24.558 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:24.692 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFb3srA3x8iOE4oCGTCgKYlL4KtTu8Yy6IzIl2pEePJZS1X7sWCI6gtowx6tziZwy0SSg__glauDxbl7pppFISadKm_I4tWAuiLajI35IsKYDgq6SNHZWyCEa24YG_APAIGRGl3bmFFD4lCItGG57ON-0suGRP7u0Kbv-pAZTVBJ3jAk 10/21/2024 02:35:24.692 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:35:24.692 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 555 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:35:28.559 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:35:33.562 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:35:33.563 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:35:33.563 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:33.563 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:35:33.563 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:33.563 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:35:33.564 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:35:33.564 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:33.564 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:35:33.564 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:33.564 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:33.564 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:35:33.565 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:37.564 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:35:42.566 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:35:42.567 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:35:42.567 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:42.567 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:35:42.567 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:42.567 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:35:42.568 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:35:42.568 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:42.568 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:35:42.568 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:42.568 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:42.568 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:35:42.568 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:46.567 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:35:51.570 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:35:51.570 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:35:51.570 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:51.570 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:35:51.570 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:51.570 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:35:51.571 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:35:51.571 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:51.571 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:35:51.571 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:51.571 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:51.571 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:35:51.572 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:55.570 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:36:00.578 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:36:00.578 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:36:00.578 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:00.578 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:36:00.578 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:00.579 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:36:00.579 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:36:00.579 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:00.579 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:36:00.579 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:00.580 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:00.580 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:36:00.580 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:04.004 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:36:04.579 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:36:09.582 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:36:09.582 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:36:09.582 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:09.583 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:36:09.583 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:09.583 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:36:09.583 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:36:09.584 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:09.584 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:36:09.584 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:09.584 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:09.584 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:36:09.584 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:13.585 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:36:18.589 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:36:18.589 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:36:18.589 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:18.589 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:36:18.590 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:18.590 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:36:18.590 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:36:18.591 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:18.591 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:36:18.591 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:18.591 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:18.591 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:36:18.591 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:22.590 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:36:25.191 7f4d3bfd08d0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFb4pUitShUaGHY-5o7mzUmTNhKoMkHPBbcs06LiWnIPFtx5I5IU1l5JqZDxFohtjWJ0WmZCWDv-G7JYhIvr0H_Av3ygdXf4aGO_Fmv-bv6_yMUxKu20AsQFS209VInPYtdu9b55jq7zUv_kUdW0_o8vE0dugqhP4ky5RkfHchHqXoKc 10/21/2024 02:36:25.192 7f4d3bfd08d0 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:36:25.192 7f4d3bfefe10 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 529 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:36:25.193 7f4d3bfefe10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 529 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:36:25.653 7f4d3bfd08d0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFb4p3zDkxUVEE0T9sUPKpqYMfaCT5LkD1f10b1Q6pcGvwcd4fNiHRysde4fjHcvGgA2zEoc5Ws3J-8c5G0BV3VAocMCn6-6_4ItL3fchQB2cdHXkefRQjoroLTgyUXTqJNPYZtl3DIYbQjsEfbznvGyZjSt_uz52-Xdt5H1s_pGN5gs 10/21/2024 02:36:25.653 7f4d3bfd08d0 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:36:25.654 7f4d43a42d68 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 575 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:36:25.654 7f4d43a42d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 575 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:36:27.592 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:36:27.592 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:36:27.592 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:27.593 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:36:27.593 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:27.593 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:36:27.593 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:36:27.593 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:27.594 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:36:27.594 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:27.594 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:27.594 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:36:27.594 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:31.593 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:36:36.596 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:36:36.596 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:36:36.596 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:36.597 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:36:36.597 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:36.597 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:36:36.598 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:36:36.598 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:36.598 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:36:36.598 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:36.598 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:36.598 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:36:36.598 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:40.601 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:36:45.606 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:36:45.607 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:36:45.607 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:45.607 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:36:45.607 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:45.607 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:36:45.607 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:36:45.608 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:45.608 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:36:45.608 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:45.608 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:45.608 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:36:45.608 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:49.609 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:36:54.613 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:36:54.613 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:36:54.613 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:54.614 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:36:54.614 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:54.614 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:36:54.614 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:36:54.614 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:54.615 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:36:54.615 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:54.615 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:54.615 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:36:54.615 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:58.616 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:37:03.619 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:37:03.620 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:37:03.620 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:03.620 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:37:03.620 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:03.620 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:37:03.621 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:37:03.621 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:03.621 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:37:03.621 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:03.621 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:03.621 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:37:03.622 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:05.475 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 10/21/2024 02:37:06.625 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 10/21/2024 02:37:07.621 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:37:12.625 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:37:12.625 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:37:12.625 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:12.625 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:37:12.625 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:12.625 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:37:12.626 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:37:12.626 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:12.626 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:37:12.626 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:12.626 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:12.626 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:37:12.626 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:16.625 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:37:21.627 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:37:21.627 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:37:21.627 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:21.628 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:37:21.628 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:21.628 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:37:21.628 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:37:21.628 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:21.629 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:37:21.629 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:21.629 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:21.629 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:37:21.629 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:25.629 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:37:26.153 7f4d3bfe8f60 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFb5mW3v_1Etz8TgINczSuWOSnLIv5ElGXsv8pq1TORz-cAiKxWp-Ugq2BKrGrr4Ee4QWQOr-9RFqy20mMXWiNO0dicQ2F3oA8u9ulbGozIUyfI003aC4MaD69d8GqLsBflak2-uGdhqPBHrJsRLy5Fchw6quiIAbYbvT9Ixu7QzFoeA 10/21/2024 02:37:26.153 7f4d3bfe8f60 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:37:26.154 7f4d4014d828 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 751 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:37:26.154 7f4d4014d828 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 751 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:37:26.631 7f4d4014d828 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFb5m3fYciGu5Q2tKy8CsRtCyrzbFjBy4JpuMhxX9fVhedslZH0TSZvTcPsYxRFnSCxvgFPV0Rd9WfZOakG5rNiRIDcAYTwJlxsd9Irkty_4zTKzsTwXtV82ZRiUFuzFDcKK8r3yd1SwoCdGXJyc9a7BSu7_Rk9tEKxBLzEnK31ZqTBI 10/21/2024 02:37:26.631 7f4d4014d828 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:37:26.631 7f4d402ccf60 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 524 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:37:26.632 7f4d402ccf60 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 524 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:37:30.635 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:37:30.635 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:37:30.635 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:30.635 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:37:30.636 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:30.636 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:37:30.636 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:37:30.636 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:30.636 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:37:30.636 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:30.636 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:30.637 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:37:30.637 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:34.638 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:37:39.641 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:37:39.641 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:37:39.641 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:39.642 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:37:39.642 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:39.642 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:37:39.642 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:37:39.642 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:39.643 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:37:39.643 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:39.643 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:39.643 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:37:39.643 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:43.642 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:37:48.645 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:37:48.645 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:37:48.645 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:48.645 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:37:48.645 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:48.645 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:37:48.646 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:37:48.646 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:48.646 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:37:48.646 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:48.646 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:48.647 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:37:48.647 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:52.647 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:37:57.649 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:37:57.649 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:37:57.649 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:57.649 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:37:57.649 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:57.649 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:37:57.650 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:37:57.650 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:57.650 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:37:57.650 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:57.650 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:57.650 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:37:57.650 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:01.650 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:38:05.231 7f4d3bfef4e0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:38:06.652 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:38:06.653 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:38:06.653 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:06.653 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:38:06.653 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:06.653 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:38:06.654 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:38:06.654 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:06.654 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:38:06.654 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:06.654 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:06.654 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:38:06.654 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:10.653 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:38:15.658 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:38:15.658 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:38:15.658 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:15.659 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:38:15.659 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:15.659 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:38:15.659 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:38:15.659 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:15.660 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:38:15.660 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:15.660 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:15.660 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:38:15.660 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:19.246 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:38:19.658 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:38:24.661 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:38:24.661 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:38:24.661 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:24.661 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:38:24.661 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:24.661 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:38:24.662 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:38:24.662 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:24.662 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:38:24.662 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:24.662 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:24.662 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:38:24.663 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:27.136 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFb6jXAUJccueco5hEUNaEkxzNC0WBrRuBwu4Q2pMyGA2xJ-VDNmiGxLW7-LkbSclWMlFJRFylwcYPLgg5Q5zMygNgfKCLwXtN9T1kTsxGQkI9sS6UUYpoA9nQ78-QXAjUTeKj-Efo9E0biAomHlbV8kqi34e4ykPBC5UmGInYCf4Rv8 10/21/2024 02:38:27.136 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:38:27.137 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 544 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:38:27.607 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFb6j343z0xHT2g9uYKKqMRey2y377UHfgIAlEE36hZbtzY9Vh9Sr5gUtICzmVC6Cc4Au6gU_9IRGafQh3TAAcW6PIDsJcex3HvzAJTKgNYKXG_yM6MjZRZNpmK3S2uLp4ktPe0sQA_ACw2OuiAeIc2XbI5WYC1iVvvV44rJflG6As08 10/21/2024 02:38:27.608 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:38:27.608 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 581 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:38:28.662 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:38:33.665 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:38:33.665 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:38:33.665 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:33.666 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:38:33.666 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:33.666 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:38:33.667 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:38:33.667 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:33.667 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:38:33.667 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:33.667 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:33.668 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:38:33.668 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:36.591 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:38:37.666 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:38:42.669 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:38:42.670 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:38:42.670 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:42.670 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:38:42.670 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:42.670 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:38:42.671 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:38:42.671 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:42.671 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:38:42.671 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:42.671 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:42.671 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:38:42.671 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:46.670 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:38:51.673 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:38:51.673 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:38:51.673 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:51.673 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:38:51.674 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:51.674 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:38:51.674 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:38:51.674 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:51.675 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:38:51.675 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:51.675 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:51.675 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:38:51.675 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:55.677 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:39:00.681 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:39:00.681 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:39:00.682 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:00.682 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:39:00.682 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:00.682 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:39:00.683 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:39:00.683 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:00.683 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:39:00.683 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:00.683 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:00.683 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:39:00.683 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:04.685 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:39:09.701 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:39:09.702 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:39:09.702 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:09.702 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:39:09.702 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:09.703 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:39:09.703 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:39:09.703 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:09.704 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:39:09.704 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:09.704 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:09.704 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:39:09.704 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:13.705 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:39:18.711 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:39:18.711 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:39:18.711 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:18.712 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:39:18.712 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:18.712 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:39:18.713 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:39:18.713 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:18.713 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:39:18.714 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:18.714 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:18.715 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:39:18.715 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:22.711 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:39:27.715 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:39:27.716 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:39:27.716 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:27.716 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:39:27.716 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:27.717 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:39:27.717 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:39:27.718 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:27.718 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:39:27.718 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:27.718 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:27.718 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:39:27.718 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:28.180 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFb7g6S5n5n6OciQnnUPW12Kvb_zSYXo7OwaIVPuEUaGdibq8qdLELGcWUNZLGJyrheV2RPOAYV-rrAT8SQZqY7lCCEzgTr8bOyAnrDC8iAMRLhylGcAPOiKGbz0uq_n84OpsiSWYsFG6myIXr6gWmCivFtk3qNOWUXep16VjN7ffTH8 10/21/2024 02:39:28.180 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:39:28.181 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 676 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:39:28.675 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFb7gbBtxPakzdmQn3D4E3fPTmYxvTR-JiGv1O37JhPe-D6RqBLPSqe9YDISgw-Df4vo5RzXiQdgdjcvSoqqrFvr54wFhjnYHmX0aN3SpFexlB2HAYAY-su8HJMx-5DXyh7owlYVIWRblhHAJWW_kvXAVerIts1JaP2n3ycqtoFXyD4Q 10/21/2024 02:39:28.675 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:39:28.676 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 543 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:39:31.716 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:39:36.718 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:39:36.719 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:39:36.719 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:36.719 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:39:36.719 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:36.719 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:39:36.720 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:39:36.720 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:36.721 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:39:36.721 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:36.721 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:36.721 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:39:36.721 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:40.721 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:39:45.725 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:39:45.725 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:39:45.725 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:45.726 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:39:45.726 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:45.726 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:39:45.726 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:39:45.727 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:45.727 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:39:45.727 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:45.727 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:45.727 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:39:45.727 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:49.728 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:39:54.733 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:39:54.733 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:39:54.733 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:54.733 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:39:54.733 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:54.733 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:39:54.734 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:39:54.734 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:54.734 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:39:54.734 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:54.734 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:54.734 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:39:54.735 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:58.735 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:40:03.739 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:40:03.740 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:40:03.740 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:03.740 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:40:03.740 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:03.740 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:40:03.741 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:40:03.741 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:03.741 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:40:03.741 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:03.741 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:03.741 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:40:03.741 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:07.741 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:40:12.744 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:40:12.744 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:40:12.744 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:12.744 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:40:12.744 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:12.744 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:40:12.745 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:40:12.745 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:12.745 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:40:12.745 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:12.745 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:12.745 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:40:12.745 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:16.744 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:40:21.747 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:40:21.747 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:40:21.747 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:21.747 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:40:21.748 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:21.748 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:40:21.748 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:40:21.748 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:21.749 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:40:21.749 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:21.749 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:21.749 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:40:21.749 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:25.751 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:40:29.184 7f4d3bfef2e8 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFb8dLmMw3Yw2E1F76_36UZOBrsYo1VydKHew7cYjIoRxdGOZbLLNx3Dg2QGcVUXEkkcMUUtzIMFKEYcImHSJeHeo2XvHDDl71ng4mU_76n6Z-5gk4EQB0Bq_TLX3Bi0ik0_bWdJE4GFLQfv4xabpSaldggvAncwwGr8LRUA5nnth9bU 10/21/2024 02:40:29.184 7f4d3bfef2e8 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:40:29.185 7f4d3bfdf390 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 597 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:40:29.185 7f4d3bfdf390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 597 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:40:29.656 7f4d3bfef2e8 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFb8dwvcL1PuGblPZttSXPFkZ9pY3tE64a2qv2CTGz2QtpR4Qk7gV9awkrcTDh-WTrm62TJIkhByZrfRBLIHIWSZvZd6QO6GNUtimb7zqK9v_3oz1wxz-PonMcB_qaWu-XI6EisCTQyfJeVe8SQ1ibQqVqWFEfX5foQqMPYRfMhuFjJw 10/21/2024 02:40:29.657 7f4d3bfef2e8 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:40:29.657 7f4d3bfcc438 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 656 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:40:29.658 7f4d3bfcc438 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 656 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:40:30.754 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:40:30.754 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:40:30.755 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:30.755 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:40:30.755 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:30.755 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:40:30.756 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:40:30.756 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:30.757 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:40:30.757 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:30.757 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:30.757 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:40:30.757 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:30.805 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:40:34.758 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:40:39.763 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:40:39.763 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:40:39.763 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:39.764 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:40:39.764 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:39.764 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:40:39.764 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:40:39.764 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:39.765 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:40:39.765 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:39.765 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:39.765 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:40:39.765 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:43.765 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:40:48.769 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:40:48.769 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:40:48.770 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:48.770 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:40:48.770 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:48.770 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:40:48.771 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:40:48.771 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:48.771 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:40:48.771 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:48.772 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:48.772 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:40:48.772 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:52.770 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:40:57.773 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:40:57.773 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:40:57.773 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:57.773 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:40:57.774 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:57.774 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:40:57.774 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:40:57.774 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:57.775 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:40:57.775 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:57.775 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:57.775 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:40:57.775 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:01.773 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:41:06.776 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:41:06.777 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:41:06.777 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:06.777 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:41:06.777 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:06.778 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:41:06.778 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:41:06.778 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:06.779 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:41:06.779 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:06.779 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:06.779 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:41:06.779 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:10.777 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:41:15.783 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:41:15.784 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:41:15.784 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:15.784 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:41:15.784 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:15.784 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:41:15.784 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:41:15.785 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:15.785 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:41:15.785 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:15.785 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:15.785 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:41:15.785 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:19.787 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:41:20.299 7f4d3bfe8e10 [contrail-analytics-api] [DEBUG]: resource list for database-node is None 10/21/2024 02:41:20.300 7f4d40d05240 [contrail-analytics-api] [INFO]: db usage:{} 10/21/2024 02:41:20.305 7f4d3bfe8e10 [contrail-analytics-api] [DEBUG]: resource list for database-node is None 10/21/2024 02:41:20.306 7f4d40d05240 [contrail-analytics-api] [INFO]: pending compaction tasks :{} 10/21/2024 02:41:24.790 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:41:24.790 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:41:24.790 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:24.791 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:41:24.791 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:24.791 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:41:24.791 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:41:24.791 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:24.792 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:41:24.792 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:24.792 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:24.792 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:41:24.792 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:28.793 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:41:30.245 7f4d401ca0f0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFb9a9CF8F4O5s1JFP-spSWc6ZrCv5e1T-IYxj0XNjlz-lJ4IoNV54WBFbQpvCOsbGZsGEpIP-cN4fV9vX3psqbLuDkECDaOW3BTehIpu73MubDXTElpHujZIBKGX1GZeIbX25KBvy19C1E9I7OW229p08QEye2Jrzw3s78aMDnPxPdk 10/21/2024 02:41:30.245 7f4d401ca0f0 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:41:30.246 7f4d40204b70 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 549 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:41:30.246 7f4d40204b70 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 549 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:41:30.757 7f4d401ca0f0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFb9a8Uv1zxBa0gbFF_PwxvVzzcKDGhANnVwHixHoPKAt-6i0EacsloDXpCMPUQOAYBAgzPWtKa3PZScqLmAzRCOYXB_hlHkk79GD_flQrMSrZ56P6VwibPeCSH7Egdu4FyUZ1288uE7D1iysMXfbZHhWU-QamAQsrJ3KoGfuShwb4Rc 10/21/2024 02:41:30.758 7f4d401ca0f0 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:41:30.758 7f4d3bfcbc18 [contrail-analytics-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 651 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:41:30.759 7f4d3bfcbc18 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 651 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:41:33.797 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:41:33.797 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:41:33.797 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:33.797 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:41:33.797 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:33.797 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:41:33.798 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:41:33.798 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:33.798 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:41:33.798 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:33.798 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:33.798 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:41:33.799 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:37.798 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:41:42.801 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:41:42.801 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:41:42.801 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:42.801 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:41:42.802 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:42.802 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:41:42.802 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:41:42.802 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:42.802 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:41:42.802 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:42.803 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:42.803 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:41:42.803 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:46.802 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:41:51.804 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:41:51.805 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:41:51.805 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:51.805 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:41:51.805 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:51.805 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:41:51.806 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:41:51.806 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:51.806 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:41:51.806 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:51.806 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:51.806 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:41:51.806 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:55.808 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:42:00.814 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:42:00.814 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:42:00.814 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:00.815 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:42:00.815 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:00.815 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:42:00.815 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:42:00.815 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:00.816 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:42:00.816 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:00.816 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:00.816 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:42:00.816 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:04.816 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:42:05.482 7f4d402cceb8 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 10/21/2024 02:42:06.635 7f4d402cceb8 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 10/21/2024 02:42:09.821 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:42:09.821 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:42:09.821 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:09.821 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:42:09.822 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:09.822 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:42:09.822 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:42:09.822 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:09.822 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:42:09.822 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:09.822 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:09.823 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:42:09.823 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:13.822 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:42:18.826 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:42:18.826 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:42:18.826 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:18.826 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:42:18.826 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:18.827 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:42:18.827 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:42:18.827 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:18.828 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:42:18.828 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:18.828 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:18.828 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:42:18.828 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:22.828 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:42:27.831 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:42:27.831 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:42:27.832 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:27.832 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:42:27.832 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:27.832 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:42:27.832 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:42:27.833 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:27.833 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:42:27.833 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:27.833 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:27.833 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:42:27.833 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:31.283 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFb-XOrQppINTx5yyxQcyCfiFhiAiHqllkgCjr_F2rDSVxblAqrvCUrALPa4iTPSmDY3GweRF8tdijhCP4Ql3I8Kz8u08lcd_5JRFuQKz1DzohPpyVPUF4zcvabQkptYWeUxaZEeCE8s0C90y9YQK1eDQws0JShKUaKF5cJS4Hbv--9o 10/21/2024 02:42:31.283 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:42:31.284 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 543 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:42:31.764 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFb-XFNBfny-hjG3lbj7dPgoWk2hYmbFOaei5EMTZ-EnhhvEa6lGu_RNOcGOt9PYuhDct9ok_Qvc9qDVfdYS-gfeJC69hkHKIJEn_i44EzwL4mjnvlHCnXNVmQGIBYKzQdLOC3wH-142BpHr6UzzeeEb6gEvoZf4zYMW_dtjtvgjgeas 10/21/2024 02:42:31.764 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:42:31.765 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 845 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:42:31.832 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:42:36.834 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:42:36.835 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:42:36.835 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:36.835 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:42:36.835 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:36.835 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:42:36.835 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:42:36.836 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:36.836 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:42:36.836 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:36.836 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:36.836 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:42:36.836 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:40.838 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:42:45.845 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:42:45.845 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:42:45.845 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:45.846 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:42:45.846 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:45.846 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:42:45.847 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:42:45.847 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:45.847 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:42:45.847 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:45.847 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:45.847 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:42:45.847 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:49.847 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:42:54.852 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:42:54.852 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:42:54.852 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:54.852 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:42:54.852 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:54.853 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:42:54.853 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:42:54.853 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:54.853 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:42:54.853 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:54.853 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:54.854 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:42:54.854 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:58.853 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:43:03.857 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:43:03.857 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:43:03.857 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:03.858 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:43:03.858 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:03.858 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:43:03.859 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:43:03.859 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:03.859 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:43:03.859 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:03.859 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:03.859 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:43:03.860 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:07.858 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:43:12.861 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:43:12.861 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:43:12.861 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:12.861 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:43:12.862 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:12.862 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:43:12.862 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:43:12.862 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:12.862 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:43:12.863 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:12.863 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:12.863 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:43:12.863 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:16.862 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:43:21.864 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:43:21.864 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:43:21.864 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:21.864 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:43:21.864 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:21.864 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:43:21.865 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:43:21.865 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:21.865 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:43:21.865 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:21.865 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:21.865 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:43:21.865 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:25.868 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:43:30.873 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:43:30.873 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:43:30.873 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:30.874 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:43:30.874 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:30.874 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:43:30.874 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:43:30.875 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:30.875 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:43:30.875 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:30.875 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:30.875 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:43:30.875 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:32.267 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFb_UfqJo5tEueKexjyjnMF378EKvZ4_O9JzV27WCbHNmnfGpw4cmJJQZuPWhI-8jFkRxw3huooM07FHn6FZrjI-mMu4EPj-X7t-G7imw4vfopYJV2bo7laVbedszMABctzheGHQf-fnjWGww951Ck2XChxCsdGLvH0Rim3LSAVIsvgs 10/21/2024 02:43:32.267 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:43:32.268 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 618 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:43:32.729 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnFb_UR4ios1h25xt0SfUs81O9-GFo8A3kOr-830xdUrtqixD_TfjD8lEid4p7cF4mE6_qeDqesPMwmEbLhYB8zfPKN_jRH_2HKOYSPV-YRUSU4AtFikUCkkzqqINnKePbyPAmFGsfMj8OUdCCshp4_m4U-h_6MAX9gnL3Uph3jZ_zI3o 10/21/2024 02:43:32.730 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: user resources are None 10/21/2024 02:43:32.730 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.30 object_type = vrouter request_url = https://10.0.0.30:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 547 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-juju-os-439-1 >> 10/21/2024 02:43:34.873 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:43:39.877 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:43:39.878 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:43:39.878 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:39.878 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:43:39.878 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:39.878 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:43:39.879 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:43:39.879 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:39.879 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:43:39.879 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:39.879 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:39.879 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:43:39.879 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:43.880 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:43:48.882 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:43:48.882 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:43:48.883 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:48.883 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:43:48.883 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:48.883 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:43:48.883 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:43:48.939 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:48.939 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:43:48.939 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:48.939 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:48.940 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:43:48.940 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:52.883 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:43:57.886 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:43:57.887 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:43:57.887 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:57.887 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:43:57.887 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:57.887 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:43:57.888 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:43:57.888 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:57.888 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:43:57.888 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:57.888 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:57.889 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:43:57.889 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:44:01.677 7f4d43c8ad68 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:44:01.887 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:44:02.664 7f4d40204e10 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/21/2024 02:44:06.889 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:44:06.889 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:44:06.889 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:44:06.889 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:44:06.890 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:44:06.890 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:44:06.890 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:44:06.890 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:44:06.890 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.30:6379, ] status = Up description = Partitions:30 >>, << type = Redis-UVE name = 10.0.0.30:6379 server_addrs = [ 10.0.0.30:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:44:06.890 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:44:06.891 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:44:06.891 7f4d43c8ad68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1729476080233653 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:44:06.891 7f4d43c8ad68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]