07/24/2025 02:21:08.052 7f24d73454c8 [contrail-analytics-api] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 07/24/2025 02:21:08.052 7f24d73454c8 [contrail-analytics-api] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 07/24/2025 02:21:08.052 7f24d73454c8 [contrail-analytics-api] [INFO]: SANDESH: Flow Logging: [None] -> [False] 07/24/2025 02:21:08.052 7f24d73454c8 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:NodeStatusUVE] map 07/24/2025 02:21:08.085 7f24d73454c8 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 07/24/2025 02:21:08.086 7f24cf6c6438 [contrail-analytics-api] [ERROR]: Cannot write http_port 8090 to /tmp/contrail-analytics-api.0.http_port 07/24/2025 02:21:08.087 7f24cf6c6438 [contrail-analytics-api] [ERROR]: Starting Introspect on HTTP Port 8090 07/24/2025 02:21:08.087 7f24cf6c2d68 [contrail-analytics-api] [INFO]: Processing event[EvStart] in state[none] 07/24/2025 02:21:08.088 7f24cf6c2d68 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 07/24/2025 02:21:08.089 7f24cf6c2d68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 07/24/2025 02:21:08.089 7f24cf6c2d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 02:21:08.089 7f24cf6c2d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3710-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.254:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, ] description = >>, ] >> 07/24/2025 02:21:08.089 7f24cf6c2d68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 02:21:08.089 7f24cf6c2d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 02:21:08.089 7f24cf6c2d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3710-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.254:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.254:6379 server_addrs = [ 10.0.0.254:6379, ] status = Initializing description = Redis Instance initialized >>, ] description = Redis-UVE:10.0.0.254:6379[Redis Instance initialized] connection down >>, ] >> 07/24/2025 02:21:08.089 7f24cf6c2d68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 02:21:08.090 7f24cf6c2d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 02:21:08.090 7f24cf6c2d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3710-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.254:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.254:6379 server_addrs = [ 10.0.0.254:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.254:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, ] description = Redis-UVE:10.0.0.254:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized] connection down >>, ] >> 07/24/2025 02:21:08.091 7f24cf6c2d68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 02:21:08.091 7f24cf6c2d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 02:21:08.091 7f24cf6c2d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] AnalyticsApiInfoUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3710-1. analytics_node_ip = { rest_api_ip : 10.0.0.254host_ip : 10.0.0.254 } >> 07/24/2025 02:21:08.091 7f24cf6c2d68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 02:21:08.091 7f24cf6c2d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 02:21:08.091 7f24cf6c2d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3710-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.254:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.254:6379 server_addrs = [ 10.0.0.254:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.254:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Redis-UVE:10.0.0.254:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 07/24/2025 02:21:08.091 7f24cf6c2d68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 02:21:08.091 7f24cf6c2d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 02:21:08.091 7f24cf6c2d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3710-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1753323668088336 collector_name = collector_ip = collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 5 max_sm_queue_count = 5 >> 07/24/2025 02:21:08.093 7f24cf6c2d68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 02:21:08.095 7f24d500cc18 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 07/24/2025 02:21:08.107 7f24d3a99b70 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 02:21:08.107 7f24d3a99b70 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3710-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.254:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.254:6379 server_addrs = [ 10.0.0.254:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.254:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Initializing description = Connection to API Server initialized >>, ] description = Redis-UVE:10.0.0.254:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[Connection to API Server initialized] connection down >>, ] >> 07/24/2025 02:21:08.107 7f24d3a99b70 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 02:21:08.113 7f24d39ff240 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 02:21:08.113 7f24d39ff240 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3710-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.254:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.254:6379 server_addrs = [ 10.0.0.254:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.254:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Initializing description = Connection to API Server initialized >>, ] description = Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[Connection to API Server initialized] connection down >>, ] >> 07/24/2025 02:21:08.113 7f24d39ff240 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 02:21:08.117 7f24d6da0e10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 02:21:08.117 7f24d6da0e10 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3710-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.254:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.254:6379 server_addrs = [ 10.0.0.254:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.254:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = Connection to API Server established >>, ] description = Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 07/24/2025 02:21:08.117 7f24d6da0e10 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 02:21:08.118 7f24d3a638d0 [contrail-analytics-api] [INFO]: Analytics Discovery listen CONNECTED 07/24/2025 02:21:08.118 7f24d3a638d0 [contrail-analytics-api] [INFO]: Analytics Discovery to publish None 07/24/2025 02:21:08.118 7f24d739bcc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 02:21:08.119 7f24d739bcc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3710-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.254:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.254:6379 server_addrs = [ 10.0.0.254:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.254:2181, ] status = Up description = Connection to Zookeeper re-established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 07/24/2025 02:21:08.119 7f24d739bcc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 02:21:08.119 7f24d739bcc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 02:21:08.119 7f24d739bcc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3710-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.254:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.254:6379 server_addrs = [ 10.0.0.254:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.254:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 07/24/2025 02:21:08.119 7f24d739bcc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 02:21:08.126 7f24d500cc18 [contrail-analytics-api] [INFO]: Analytics Discovery Watcher AlarmGenerator Children [] 07/24/2025 02:21:08.128 7f24d500cc18 [contrail-analytics-api] [INFO]: Analytics Discovery OpServer reconnect 07/24/2025 02:21:08.132 7f24d500cc18 [contrail-analytics-api] [INFO]: ensure /analytics-discovery-/OpServer 07/24/2025 02:21:08.132 7f24d500cc18 [contrail-analytics-api] [INFO]: zk state CONNECTED (CONNECTED) 07/24/2025 02:21:08.139 7f24d500cc18 [contrail-analytics-api] [INFO]: check for /analytics-discovery-/OpServer/cn-jenkins-deploy-platform-ansible-os-3710-1.-0 07/24/2025 02:21:12.089 7f24d3a2e8d0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 02:21:12.090 7f24d3a2e8d0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 07/24/2025 02:21:12.090 7f24d3a2e8d0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 02:21:12.090 7f24d3a2e8d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 02:21:12.090 7f24d3a2e8d0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3710-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.254:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.254:6379 server_addrs = [ 10.0.0.254:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.254:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/24/2025 02:21:12.090 7f24d3a2e8d0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 02:21:12.091 7f24d3a2e8d0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 07/24/2025 02:21:12.091 7f24d3a2e8d0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 07/24/2025 02:21:12.091 7f24d3a2e8d0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 07/24/2025 02:21:12.091 7f24d3a2e8d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 07/24/2025 02:21:12.091 7f24d3a2e8d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 07/24/2025 02:21:12.091 7f24d3a2e390 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 07/24/2025 02:21:12.093 7f24d3a2e390 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 07/24/2025 02:21:12.099 7f24cf6c2ac8 [contrail-analytics-api] [DEBUG]: Extracted sandesh length: 0000001017 07/24/2025 02:21:12.100 7f24cf6c2ac8 [contrail-analytics-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 07/24/2025 02:21:12.100 7f24ceb128d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 07/24/2025 02:21:12.100 7f24ceb128d0 [contrail-analytics-api] [DEBUG]: Number of uve types in sandesh control message is 0 07/24/2025 02:21:12.100 7f24ceb128d0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 07/24/2025 02:21:12.100 7f24ceb128d0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 07/24/2025 02:21:12.100 7f24ceb128d0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 07/24/2025 02:21:12.101 7f24ceb128d0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 07/24/2025 02:21:12.101 7f24d3a2e390 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 07/24/2025 02:21:12.102 7f24d3a2e390 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 07/24/2025 02:21:16.510 7f24ceb128d0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABogZic9o2SS-44XJAqqBKQurzCmQUay35Gv8GfNdkKVhtkMjMmUBoK5EZr823II377eubqHI4X4eTuE9CdV-gOzo1sB3uABqEqF89z5Ol5x3wGgEBGyEYR6jlsKF01pAZk-huTxtElvtLRYZKbrpIB9QUaQzC8WruoJphYxhWgxno7UC4 07/24/2025 02:21:16.511 7f24ceb128d0 [contrail-analytics-api] [DEBUG]: user resources are None 07/24/2025 02:21:16.513 7f24d3a5f978 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.254 object_type = vrouter request_url = http://10.0.0.254:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 1828 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3710-1. >> 07/24/2025 02:21:16.850 7f24ceb128d0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABogZic5NWYtkXA3yBPaG1iqn4GE-lNJQsmqVeR2GYcRRrWzpDfn-gctysgLHy2dHsVQQOkQ3UTUZDLp4oySxrMmyrX8ud4yILIec7MTSzZgIQR6qX9Og1JHyFtX3n80GapKS64Tl-8DKXnHFDNtwfwZJXmJy1cRd-iaLdjSZ9e0Sdu3lg 07/24/2025 02:21:16.851 7f24ceb128d0 [contrail-analytics-api] [DEBUG]: user resources are None 07/24/2025 02:21:16.851 7f24d6da0cc0 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.254 object_type = vrouter request_url = http://10.0.0.254:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 778 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3710-1. >> 07/24/2025 02:21:21.196 7f24cf6c2ac8 [contrail-analytics-api] [DEBUG]: Extracted sandesh length: 0000001436 07/24/2025 02:21:21.196 7f24cf6c2ac8 [contrail-analytics-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 07/24/2025 02:21:21.197 7f24ccebcd68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 07/24/2025 02:21:21.197 7f24ccebcd68 [contrail-analytics-api] [DEBUG]: Number of uve types in sandesh control message is 3 07/24/2025 02:21:21.197 7f24ccebcd68 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 07/24/2025 02:21:21.197 7f24ccebcd68 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 07/24/2025 02:21:21.197 7f24ccebcd68 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 07/24/2025 02:21:21.197 7f24d6da0cc0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 07/24/2025 02:21:21.197 7f24d6da0cc0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 07/24/2025 02:21:22.716 7f24d3a63780 [contrail-analytics-api] [INFO]: Analytics Discovery Watcher AlarmGenerator Children ['cn-jenkins-deploy-platform-ansible-os-3710-1.-0'] 07/24/2025 02:21:28.143 7f24d500cc18 [contrail-analytics-api] [INFO]: Analytics Discovery OpServer reconnect 07/24/2025 02:21:28.143 7f24d500cc18 [contrail-analytics-api] [INFO]: ensure /analytics-discovery-/OpServer 07/24/2025 02:21:28.144 7f24d500cc18 [contrail-analytics-api] [INFO]: zk state CONNECTED (CONNECTED) 07/24/2025 02:21:28.145 7f24d500cc18 [contrail-analytics-api] [INFO]: check for /analytics-discovery-/OpServer/cn-jenkins-deploy-platform-ansible-os-3710-1.-0 07/24/2025 02:21:28.148 7f24d500cc18 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-3710-1.-0, data b'{"ip-address": "10.0.0.254", "instance-id": "0", "redis-ip": "10.0.0.254", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{}"}', event None 07/24/2025 02:21:28.149 7f24d500cc18 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-3710-1.-0, data OrderedDict([('instance-id', '0'), ('ip-address', '10.0.0.254'), ('partitions', '{}'), ('redis-agg-db', 7), ('redis-ip', '10.0.0.254'), ('redis-port', '6379')]), event GET 07/24/2025 02:21:31.867 7f24d3a63780 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-3710-1.-0, data b'{"ip-address": "10.0.0.254", "instance-id": "0", "redis-ip": "10.0.0.254", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{}"}', event WatchedEvent(type='CHANGED', state='CONNECTED', path='/analytics-discovery-/AlarmGenerator/cn-jenkins-deploy-platform-ansible-os-3710-1.-0') 07/24/2025 02:21:32.807 7f24d3a63780 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-3710-1.-0, data b'{"ip-address": "10.0.0.254", "instance-id": "0", "redis-ip": "10.0.0.254", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{\\"0\\": 1753323692081019, \\"1\\": 1753323692087690, \\"3\\": 1753323692104309, \\"2\\": 1753323692104481, \\"4\\": 1753323692132429, \\"5\\": 1753323692156182, \\"6\\": 1753323692176231, \\"7\\": 1753323692197390, \\"8\\": 1753323692218707, \\"9\\": 1753323692228023, \\"10\\": 1753323692245382, \\"11\\": 1753323692269771, \\"12\\": 1753323692283806, \\"13\\": 1753323692299621, \\"14\\": 1753323692320232, \\"15\\": 1753323692338472, \\"16\\": 1753323692353605, \\"17\\": 1753323692368719, \\"18\\": 1753323692380340, \\"19\\": 1753323692407283, \\"20\\": 1753323692424484, \\"21\\": 1753323692449395, \\"22\\": 1753323692469546, \\"23\\": 1753323692482791, \\"24\\": 1753323692504036, \\"25\\": 1753323692529921, \\"26\\": 1753323692554658, \\"27\\": 1753323692575973, \\"29\\": 1753323692593584, \\"28\\": 1753323692594293}"}', event WatchedEvent(type='CHANGED', state='CONNECTED', path='/analytics-discovery-/AlarmGenerator/cn-jenkins-deploy-platform-ansible-os-3710-1.-0') 07/24/2025 02:22:17.194 7f24d3a5f828 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABogZjZKpyQg2YHyO97BMK9F1A4o3i0MA_CcqTX1ssqFPYC36VVHaGYbX2T708rgoNGnR-g56uD3sjGTXJYIdMTyoGRjwcv_SVDzKH3eA2ce_n5uzj7xrCC-lcqIOLFchG6oi0KJYX821Q6ZblkxonQtl0oCS1quHqQFikDgeh4o7UI-j0 07/24/2025 02:22:17.194 7f24d3a5f828 [contrail-analytics-api] [DEBUG]: user resources are None 07/24/2025 02:22:17.196 7f24d3a2ea20 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.254 object_type = vrouter request_url = http://10.0.0.254:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 850 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3710-1. >> 07/24/2025 02:22:17.535 7f24d3a5f828 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABogZjZfVjlWsXdNZ_teA0qTCSxRH-N8mvToqc3Hgqhr23L2pAac21GFBbOI3QOiv4NJgVpspJqnixuIdCbBkrGWwkZ_IIyzk_FjAXzgOo-AlIbXli7aL2oA4p0FipSLoPQFkHiRJUbkHha0ueMLVFIkv-N1CoGO3I6R2gP8B7do5_w93E 07/24/2025 02:22:17.535 7f24d3a5f828 [contrail-analytics-api] [DEBUG]: user resources are None 07/24/2025 02:22:17.536 7f24d3a9f780 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.254 object_type = vrouter request_url = http://10.0.0.254:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 863 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3710-1. >> 07/24/2025 02:23:02.934 7f24d3a5f828 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 07/24/2025 02:23:05.083 7f24d3a5f828 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 07/24/2025 02:23:17.872 7f24d3a5f828 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABogZkVISDQJRvu7nxyRcQK1ovRxcr4ea_8m7R2z8wDcDsWA6KzzE9wAOOTTROx37AR15M6_jY4fNLFqtDadJawZ239hj3qF5-oWYULuisI-gN4L6IdCieS-l9r2a2CSAYDbQK0tx4H2zAYYQaPUDOcMf5euiLO73-rTEN3EZD2OZ6eFOM 07/24/2025 02:23:17.872 7f24d3a5f828 [contrail-analytics-api] [DEBUG]: user resources are None 07/24/2025 02:23:17.873 7f24d3a5f780 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.254 object_type = vrouter request_url = http://10.0.0.254:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 1424 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3710-1. >> 07/24/2025 02:23:18.207 7f24d3a5f828 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABogZkW-BBzsNMp1C4CW8nUvZHkDCn3oe0j4YG1NM8sAtfnzkQNq-P95Gu54nPKuePknNOXb7xr5l22C5kIl6126rQQlvUoTVud0Ky6ZaXf8dzEnkMKlspj9mxQfubnrerOPbRB94m_WG_iTnoyyNHsBKtJlBd9KMDo9lG4A8bWvNuOMNg 07/24/2025 02:23:18.207 7f24d3a5f828 [contrail-analytics-api] [DEBUG]: user resources are None 07/24/2025 02:23:18.209 7f24d3a5f828 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3710-1 as ['NodeStatus'] 07/24/2025 02:23:18.210 7f24d3a29cc0 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.254 object_type = vrouter request_url = http://10.0.0.254:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 2804 response_size_objects = 1 response_size_bytes = 932 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3710-1. >> 07/24/2025 02:24:18.680 7f24d3a5f828 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABogZlSjdgxJppzQf1U0K8GV5Ie73_3F4B2fIK3ySc3gDrD88BONL0d8tFFs78sCiw14CpoMTpl8VBA1Xc4aarERBgPG2I84ZTlgmyD_abyHeISTPgYIxa6g7esjwLYTmgQIiwWPEqpXSD3XzedTXxULH0CAGZVlV9CJf4rnHNVE7lUeWM 07/24/2025 02:24:18.681 7f24d3a5f828 [contrail-analytics-api] [DEBUG]: user resources are None 07/24/2025 02:24:18.682 7f24d3a5f828 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3710-1 as ['VrouterAgent'] 07/24/2025 02:24:18.683 7f24d7332b70 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.254 object_type = vrouter request_url = http://10.0.0.254:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 2253 response_size_objects = 1 response_size_bytes = 104 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3710-1. >> 07/24/2025 02:24:19.074 7f24d3a5f828 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABogZlSsJGFT2CQGLxFquRw2_8QLSrWHp5Q6VT0mUxLFxXrikLEVRhVlo27XNH8-nyl7dKbY3i0lNK98PDLjjcyG93_ym8JSHKrpiO5VDRbEypTx9mkAsPNdc5fGLc08n8cWuqLZCGJ3UqP5QoA1Ckslj6EILd5sML_Ti7dMb5t-5XOe8c 07/24/2025 02:24:19.074 7f24d3a5f828 [contrail-analytics-api] [DEBUG]: user resources are None 07/24/2025 02:24:19.077 7f24d3a5f828 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3710-1 as ['NodeStatus'] 07/24/2025 02:24:19.078 7f24d6e3bb70 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.254 object_type = vrouter request_url = http://10.0.0.254:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 3824 response_size_objects = 1 response_size_bytes = 932 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3710-1. >> 07/24/2025 02:24:28.389 7f24d3a5f828 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 07/24/2025 02:24:28.754 7f24d3a5f828 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 07/24/2025 02:25:19.449 7f24d3a5f828 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABogZmP-TJ8jKvXY4AJrCdm1XnVl4nmg1iJE25iMdSmRyt1M6nOCTQsHXvt6m8mGnvQHWEUtCzk0gkUwzKBUvF5HfR9N6xMeWHqO-7P-d8omiSzGGS_H1ZC6wNKGHuVFIfRav1UbFrXGLTKNsYSAPJVewvGjfNW7xBAy-NNc7a59h-VD1I 07/24/2025 02:25:19.449 7f24d3a5f828 [contrail-analytics-api] [DEBUG]: user resources are None 07/24/2025 02:25:19.451 7f24d3a5f828 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3710-1 as ['VrouterAgent'] 07/24/2025 02:25:19.452 7f24d3a294e0 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.254 object_type = vrouter request_url = http://10.0.0.254:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 2254 response_size_objects = 1 response_size_bytes = 104 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3710-1. >> 07/24/2025 02:25:19.844 7f24d3a294e0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABogZmPBm2-AP3bg_sjBSTakCTvRKzRbsB3CZwfLvhFzyAfEm2eiCY6RTBY8IzFoNP1mpZ_bJU5Kr50t6Jb2D2cqbMRPfQoFw4BE12nSXzjRpzIziUVyAd3xmedjjpoU9Jd1ePYG5qZ9uAi8Bytlvqg-q9XLhnqHCRzH7OBu6oMVidpBRs 07/24/2025 02:25:19.844 7f24d3a294e0 [contrail-analytics-api] [DEBUG]: user resources are None 07/24/2025 02:25:19.847 7f24d3a294e0 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3710-1 as ['NodeStatus'] 07/24/2025 02:25:19.847 7f24d3a63f60 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.254 object_type = vrouter request_url = http://10.0.0.254:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 3443 response_size_objects = 1 response_size_bytes = 932 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3710-1. >> 07/24/2025 02:26:21.009 7f24d5bf0a20 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABogZnM2B2DfavzyFrUD4Dkza6TGWXG4T5Mb5UOSuZvefjFHepazKk3TiBaLsgSMKsF1mDPlN7jT_UeN-4tkS3Hta1a_OnlrHVY5tLbCd5ZuYhJawS_g16pg0aKbZNWBEtGq2lbKE-RC04S4InE5MUcmgMbjz3tgQuxA9-imRabdPEq4K0 07/24/2025 02:26:21.009 7f24d5bf0a20 [contrail-analytics-api] [DEBUG]: user resources are None 07/24/2025 02:26:21.011 7f24d5bf0a20 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3710-1 as ['VrouterAgent'] 07/24/2025 02:26:21.011 7f24d3a99588 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.254 object_type = vrouter request_url = http://10.0.0.254:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 2080 response_size_objects = 1 response_size_bytes = 104 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3710-1. >> 07/24/2025 02:26:21.355 7f24d5bf0a20 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABogZnNLw1jxPidTC9WDe8nSu83TwYP7LfpL27rjCAkTipztV7cx2L8us1A2wF4FJDAZtUsMSjgVqRQJCes9QpxjHp5Ak-RCgoBpBsa4MqQwIXv_CysjoGi03eZoEL7j09W6w1-GxmgWMGCpgi2npjC6UgXIiMMCNBAEhr6nldHanFSoGY 07/24/2025 02:26:21.355 7f24d5bf0a20 [contrail-analytics-api] [DEBUG]: user resources are None 07/24/2025 02:26:21.357 7f24d5bf0a20 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3710-1 as ['NodeStatus'] 07/24/2025 02:26:21.358 7f24d3a2ca20 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.254 object_type = vrouter request_url = http://10.0.0.254:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 2575 response_size_objects = 1 response_size_bytes = 932 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3710-1. >> 07/24/2025 02:26:32.799 7f24d5bf0a20 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map