10/31/2024 02:25:59.275 7f3f58a7e988 [contrail-analytics-api] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 10/31/2024 02:25:59.275 7f3f58a7e988 [contrail-analytics-api] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 10/31/2024 02:25:59.276 7f3f58a7e988 [contrail-analytics-api] [INFO]: SANDESH: Flow Logging: [None] -> [False] 10/31/2024 02:25:59.276 7f3f58a7e988 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/31/2024 02:25:59.317 7f3f58a7e988 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 10/31/2024 02:25:59.319 7f3f53c47978 [contrail-analytics-api] [ERROR]: Cannot write http_port 8090 to /tmp/contrail-analytics-api.0.http_port 10/31/2024 02:25:59.319 7f3f53c47978 [contrail-analytics-api] [ERROR]: Starting Introspect on HTTP Port 8090 10/31/2024 02:25:59.320 7f3f53bcf2e8 [contrail-analytics-api] [INFO]: Processing event[EvStart] in state[none] 10/31/2024 02:25:59.320 7f3f53bcf2e8 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/31/2024 02:25:59.320 7f3f53bcf2e8 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 10/31/2024 02:25:59.321 7f3f53bcf2e8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:25:59.321 7f3f53bcf2e8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2181-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.54:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, ] description = >>, ] >> 10/31/2024 02:25:59.321 7f3f53bcf2e8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:25:59.321 7f3f53bcf2e8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:25:59.322 7f3f53bcf2e8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2181-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.54:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.54:6379 server_addrs = [ 10.0.0.54:6379, ] status = Initializing description = Redis Instance initialized >>, ] description = Redis-UVE:10.0.0.54:6379[Redis Instance initialized] connection down >>, ] >> 10/31/2024 02:25:59.323 7f3f53bcf2e8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:25:59.323 7f3f53bcf2e8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:25:59.323 7f3f53bcf2e8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2181-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.54:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.54:6379 server_addrs = [ 10.0.0.54:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.54:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, ] description = Redis-UVE:10.0.0.54:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized] connection down >>, ] >> 10/31/2024 02:25:59.324 7f3f53bcf2e8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:25:59.324 7f3f53bcf2e8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:25:59.324 7f3f53bcf2e8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] AnalyticsApiInfoUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2181-1. analytics_node_ip = { rest_api_ip : 10.0.0.54host_ip : 10.0.0.54 } >> 10/31/2024 02:25:59.324 7f3f53bcf2e8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:25:59.324 7f3f53bcf2e8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:25:59.324 7f3f53bcf2e8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2181-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.54:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.54:6379 server_addrs = [ 10.0.0.54:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.54:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Redis-UVE:10.0.0.54:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/31/2024 02:25:59.324 7f3f53bcf2e8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:25:59.324 7f3f53bcf2e8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:25:59.325 7f3f53bcf2e8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2181-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1730341559320649 collector_name = collector_ip = collector_list = [ 10.0.0.54:8086, ] >> sm_queue_count = 5 max_sm_queue_count = 5 >> 10/31/2024 02:25:59.326 7f3f53bcf2e8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:25:59.327 7f3f55e46e10 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 10/31/2024 02:25:59.338 7f3f53bb8d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:25:59.339 7f3f53bb8d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2181-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.54:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.54:6379 server_addrs = [ 10.0.0.54:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.54:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.54:8082, ] status = Initializing description = Connection to API Server initialized >>, ] description = Redis-UVE:10.0.0.54:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[Connection to API Server initialized] connection down >>, ] >> 10/31/2024 02:25:59.339 7f3f53bb8d68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:25:59.344 7f3f53189240 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:25:59.344 7f3f53189240 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2181-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.54:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.54:6379 server_addrs = [ 10.0.0.54:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.54:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.54:8082, ] status = Initializing description = Connection to API Server initialized >>, ] description = Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[Connection to API Server initialized] connection down >>, ] >> 10/31/2024 02:25:59.345 7f3f53189240 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:25:59.348 7f3f5316e978 [contrail-analytics-api] [INFO]: Analytics Discovery listen CONNECTED 10/31/2024 02:25:59.348 7f3f5316e978 [contrail-analytics-api] [INFO]: Analytics Discovery to publish None 10/31/2024 02:25:59.349 7f3f53189390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:25:59.349 7f3f53189390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2181-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.54:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.54:6379 server_addrs = [ 10.0.0.54:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.54:2181, ] status = Up description = Connection to Zookeeper re-established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.54:8082, ] status = Initializing description = Connection to API Server initialized >>, ] description = Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[Connection to API Server initialized] connection down >>, ] >> 10/31/2024 02:25:59.350 7f3f53189390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:25:59.350 7f3f53189390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:25:59.351 7f3f53189390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2181-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.54:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.54:6379 server_addrs = [ 10.0.0.54:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.54:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.54:8082, ] status = Initializing description = Connection to API Server initialized >>, ] description = Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[Connection to API Server initialized] connection down >>, ] >> 10/31/2024 02:25:59.351 7f3f53189390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:25:59.355 7f3f589732e8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:25:59.355 7f3f589732e8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2181-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.54:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.54:6379 server_addrs = [ 10.0.0.54:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.54:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.54:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/31/2024 02:25:59.355 7f3f589732e8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/31/2024 02:25:59.361 7f3f55e46e10 [contrail-analytics-api] [INFO]: Analytics Discovery Watcher AlarmGenerator Children [] 10/31/2024 02:25:59.364 7f3f55e46e10 [contrail-analytics-api] [INFO]: Analytics Discovery OpServer reconnect 10/31/2024 02:25:59.365 7f3f55e46e10 [contrail-analytics-api] [INFO]: ensure /analytics-discovery-/OpServer 10/31/2024 02:25:59.365 7f3f55e46e10 [contrail-analytics-api] [INFO]: zk state CONNECTED (CONNECTED) 10/31/2024 02:25:59.372 7f3f55e46e10 [contrail-analytics-api] [INFO]: check for /analytics-discovery-/OpServer/cn-jenkins-deploy-platform-ansible-os-2181-1.-0 10/31/2024 02:26:03.324 7f3f53144eb8 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/31/2024 02:26:03.325 7f3f53144eb8 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 10/31/2024 02:26:03.326 7f3f53144eb8 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/31/2024 02:26:03.326 7f3f53144eb8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/31/2024 02:26:03.326 7f3f53144eb8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2181-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.54:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.54:6379 server_addrs = [ 10.0.0.54:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.54:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.54:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.54:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/31/2024 02:26:03.326 7f3f53144eb8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/31/2024 02:26:03.326 7f3f53144eb8 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 10/31/2024 02:26:03.326 7f3f53144eb8 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 10/31/2024 02:26:03.327 7f3f53144eb8 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 10/31/2024 02:26:03.327 7f3f53144eb8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/31/2024 02:26:03.327 7f3f53144eb8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/31/2024 02:26:03.327 7f3f53144390 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 10/31/2024 02:26:03.328 7f3f53144390 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 10/31/2024 02:26:03.331 7f3f53144ac8 [contrail-analytics-api] [DEBUG]: Extracted sandesh length: 0000001017 10/31/2024 02:26:03.332 7f3f53144ac8 [contrail-analytics-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 10/31/2024 02:26:03.332 7f3f53146240 [contrail-analytics-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 10/31/2024 02:26:03.332 7f3f53146240 [contrail-analytics-api] [DEBUG]: Number of uve types in sandesh control message is 0 10/31/2024 02:26:03.332 7f3f53146240 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 10/31/2024 02:26:03.333 7f3f53146240 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/31/2024 02:26:03.333 7f3f53146240 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/31/2024 02:26:03.333 7f3f53146240 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 10/31/2024 02:26:03.333 7f3f571b0d68 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 10/31/2024 02:26:03.336 7f3f571b0d68 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 10/31/2024 02:26:15.829 7f3f571b0d68 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnIurHAX4LC0eR6cPUuWl0XHehWYdiaUkwmHDWr--SVJgXHodOcIyAa5fS8GZ3dsuTcjiYifpVybkGPzZALsoUnnDjo5NDFx7o0ff-GGIAck_776nwZkfB4NbcrGv-Xc4J2Q62kXDrbFih8spD7n_koB-sHbYoY3SjkjSFB1vbgKINTaQ 10/31/2024 02:26:15.830 7f3f571b0d68 [contrail-analytics-api] [DEBUG]: user resources are None 10/31/2024 02:26:15.831 7f3f53144eb8 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.54 object_type = vrouter request_url = http://10.0.0.54:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 1396 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-2181-1. >> 10/31/2024 02:26:16.255 7f3f571b0d68 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnIurIXnADng8a9E6nC0yrPkD1_pQnVtc-y5_MWRVh9JtydufEN3LmPUjQijBPk901sksG1JgoI_dLFp69Lr4YS8Do_-Zaef6Dh8AL8Xuq0rd9q8VTFHJqus-CZS-F9r7ic_s8dAujSb0ZYvHuj7h1SCXWcyDslu9VJCp-qmIaWs1u0is 10/31/2024 02:26:16.255 7f3f571b0d68 [contrail-analytics-api] [DEBUG]: user resources are None 10/31/2024 02:26:16.257 7f3f531466d8 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.54 object_type = vrouter request_url = http://10.0.0.54:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 1922 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-2181-1. >> 10/31/2024 02:26:17.144 7f3f53144ac8 [contrail-analytics-api] [DEBUG]: Extracted sandesh length: 0000001436 10/31/2024 02:26:17.145 7f3f53144ac8 [contrail-analytics-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 10/31/2024 02:26:17.146 7f3f53146a20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 10/31/2024 02:26:17.146 7f3f53146a20 [contrail-analytics-api] [DEBUG]: Number of uve types in sandesh control message is 3 10/31/2024 02:26:17.146 7f3f53146a20 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 10/31/2024 02:26:17.146 7f3f53146a20 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/31/2024 02:26:17.146 7f3f53146a20 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/31/2024 02:26:17.146 7f3f531466d8 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 10/31/2024 02:26:17.147 7f3f531466d8 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 10/31/2024 02:26:20.050 7f3f5316e780 [contrail-analytics-api] [INFO]: Analytics Discovery Watcher AlarmGenerator Children ['cn-jenkins-deploy-platform-ansible-os-2181-1.-0'] 10/31/2024 02:26:29.377 7f3f55e46e10 [contrail-analytics-api] [INFO]: Analytics Discovery OpServer reconnect 10/31/2024 02:26:29.378 7f3f55e46e10 [contrail-analytics-api] [INFO]: ensure /analytics-discovery-/OpServer 10/31/2024 02:26:29.378 7f3f55e46e10 [contrail-analytics-api] [INFO]: zk state CONNECTED (CONNECTED) 10/31/2024 02:26:29.379 7f3f55e46e10 [contrail-analytics-api] [INFO]: check for /analytics-discovery-/OpServer/cn-jenkins-deploy-platform-ansible-os-2181-1.-0 10/31/2024 02:26:29.384 7f3f55e46e10 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-2181-1.-0, data b'{"ip-address": "10.0.0.54", "instance-id": "0", "redis-ip": "10.0.0.54", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{}"}', event None 10/31/2024 02:26:29.386 7f3f55e46e10 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-2181-1.-0, data OrderedDict([('instance-id', '0'), ('ip-address', '10.0.0.54'), ('partitions', '{}'), ('redis-agg-db', 7), ('redis-ip', '10.0.0.54'), ('redis-port', '6379')]), event GET 10/31/2024 02:26:31.054 7f3f5316e780 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-2181-1.-0, data b'{"ip-address": "10.0.0.54", "instance-id": "0", "redis-ip": "10.0.0.54", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{\\"2\\": 1730341589428958, \\"5\\": 1730341589441125, \\"0\\": 1730341589442027, \\"10\\": 1730341589456035, \\"6\\": 1730341589456851, \\"4\\": 1730341589457080, \\"3\\": 1730341589457275, \\"1\\": 1730341589457461, \\"24\\": 1730341589477418, \\"23\\": 1730341589478440, \\"22\\": 1730341589479464, \\"21\\": 1730341589481290, \\"20\\": 1730341589482457, \\"19\\": 1730341589483561, \\"11\\": 1730341589486193, \\"9\\": 1730341589487220, \\"8\\": 1730341589487866, \\"7\\": 1730341589488175, \\"17\\": 1730341589654979, \\"16\\": 1730341589655295, \\"14\\": 1730341589655531, \\"13\\": 1730341589655743, \\"12\\": 1730341589655981, \\"18\\": 1730341589785577, \\"15\\": 1730341589785969, \\"27\\": 1730341589924826, \\"26\\": 1730341589925068, \\"25\\": 1730341589925269, \\"28\\": 1730341590147442}"}', event WatchedEvent(type='CHANGED', state='CONNECTED', path='/analytics-discovery-/AlarmGenerator/cn-jenkins-deploy-platform-ansible-os-2181-1.-0') 10/31/2024 02:26:31.186 7f3f5316e780 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-2181-1.-0, data b'{"ip-address": "10.0.0.54", "instance-id": "0", "redis-ip": "10.0.0.54", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{\\"2\\": 1730341589428958, \\"5\\": 1730341589441125, \\"0\\": 1730341589442027, \\"10\\": 1730341589456035, \\"6\\": 1730341589456851, \\"4\\": 1730341589457080, \\"3\\": 1730341589457275, \\"1\\": 1730341589457461, \\"24\\": 1730341589477418, \\"23\\": 1730341589478440, \\"22\\": 1730341589479464, \\"21\\": 1730341589481290, \\"20\\": 1730341589482457, \\"19\\": 1730341589483561, \\"11\\": 1730341589486193, \\"9\\": 1730341589487220, \\"8\\": 1730341589487866, \\"7\\": 1730341589488175, \\"17\\": 1730341589654979, \\"16\\": 1730341589655295, \\"14\\": 1730341589655531, \\"13\\": 1730341589655743, \\"12\\": 1730341589655981, \\"18\\": 1730341589785577, \\"15\\": 1730341589785969, \\"27\\": 1730341589924826, \\"26\\": 1730341589925068, \\"25\\": 1730341589925269, \\"28\\": 1730341590147442, \\"29\\": 1730341590447893}"}', event WatchedEvent(type='CHANGED', state='CONNECTED', path='/analytics-discovery-/AlarmGenerator/cn-jenkins-deploy-platform-ansible-os-2181-1.-0') 10/31/2024 02:27:16.735 7f3f53144eb8 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnIusEyokoam-bH7zPUzsKdDnFGt70tag51dQhhcNlwTpz9Muybz3fu8QJeTPXBFd6iCkTtzOdy-xahsGVFivHP5dw7AUNyTXG7AElDoKO_ORVZuc31lp9Ertuu9vv7mfR-ymyM1lJPkiJV11ev9b9XyRDQykx-k_sRNr48xbBgnUxtM4 10/31/2024 02:27:16.735 7f3f53144eb8 [contrail-analytics-api] [DEBUG]: user resources are None 10/31/2024 02:27:16.736 7f3f53146cc0 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.54 object_type = vrouter request_url = http://10.0.0.54:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 992 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-2181-1. >> 10/31/2024 02:27:17.165 7f3f53144eb8 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnIusFdNC6VlGXey9ZA0M2LNV5ykpA6ueS9pc17BcmohGGWSZ2G2vvLosAkEIMYSHiVqCl_-xCfNFDofCmq6fFA0koHWbGBzxltLblmO44tPm9-dgl1nX0XuZntgi7Z15YOHC3n0Q5x1j1RHgMBvuCBHh7dFJxZPbs46XHu5cv_JWTKWw 10/31/2024 02:27:17.165 7f3f53144eb8 [contrail-analytics-api] [DEBUG]: user resources are None 10/31/2024 02:27:17.168 7f3f53146eb8 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.54 object_type = vrouter request_url = http://10.0.0.54:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 2182 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-2181-1. >> 10/31/2024 02:27:55.878 7f3f53144eb8 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 10/31/2024 02:27:56.519 7f3f53144eb8 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 10/31/2024 02:28:17.583 7f3f53144eb8 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnIutBWpsf7zwt3ZX9v4Z4JvDRVZnHoQDFtUqsTgTJSWZW1uZuSz-OWrq6pzuVn1q3Igs76uqIygdL69wWuepR45sFxX85F8d9Yxn1n6_ZbuloZUnVJWkdWqAg-hSO8qbJPvlkoWUs9EXmQZfD9FyYenDEZC7kSiDPZweGES1vPql-RRI 10/31/2024 02:28:17.583 7f3f53144eb8 [contrail-analytics-api] [DEBUG]: user resources are None 10/31/2024 02:28:17.585 7f3f53146588 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.54 object_type = vrouter request_url = http://10.0.0.54:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 2072 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-2181-1. >> 10/31/2024 02:28:18.036 7f3f53144eb8 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnIutB1IkWsFC2e0yNjnDlSMLQE3gxG08kdOENILbxF4h6KbCWduDzxhJgVU3EKhUeh0xkOyK6D56nABYl9gHp9VSwKdX397zpBsJndbM4xnxypVZSnSBIVYR-P-qc21Pi6ATWfE7uJ33H-_fOr2r65wO520XnWOqlCtnNKgHJ5YiTD-U 10/31/2024 02:28:18.036 7f3f53144eb8 [contrail-analytics-api] [DEBUG]: user resources are None 10/31/2024 02:28:18.039 7f3f53144eb8 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-2181-1 as ['NodeStatus'] 10/31/2024 02:28:18.040 7f3f568ba8d0 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.54 object_type = vrouter request_url = http://10.0.0.54:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 3846 response_size_objects = 1 response_size_bytes = 629 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-2181-1. >> 10/31/2024 02:28:25.323 7f3f53144eb8 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/31/2024 02:28:27.718 7f3f53bb8588 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 10/31/2024 02:29:18.451 7f3f53bb8588 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnIut-CGnIelFJC9jJ2DRqRD5b23X0dOgR8I4LDGsMQWYL8Uduab7XWTWdRpYxDPbgxbywel8B8kmfwF0gX9agztB61miaXAz2eT5-wbB0Rje3883ub01MgMD7dNgMujewH_izIAVSZeKzYLKgk-5hnCgF-NdQyZ_owMUuB2z4erUsN9s 10/31/2024 02:29:18.451 7f3f53bb8588 [contrail-analytics-api] [DEBUG]: user resources are None 10/31/2024 02:29:18.455 7f3f53bb8588 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-2181-1 as ['VrouterAgent'] 10/31/2024 02:29:18.456 7f3f53142c18 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.54 object_type = vrouter request_url = http://10.0.0.54:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 4150 response_size_objects = 1 response_size_bytes = 104 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-2181-1. >> 10/31/2024 02:29:18.868 7f3f53142c18 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnIut-OS0IKQhuWtQIlEz4HO9Xa3pA89p-2u4G4TtnpAN_Rat6uQit_DXMqVEROs8HR5WPZCi_F95zoZ2tjiUqXRDm4NjmeLO87MPMZfNOQeFdClZhy7eFBxPpbrO2IEp35r78OLnHW--BrJMufkMo9Fy7PmJvApI3Apyscp9uf_4mJxY 10/31/2024 02:29:18.868 7f3f53142c18 [contrail-analytics-api] [DEBUG]: user resources are None 10/31/2024 02:29:18.871 7f3f53142c18 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-2181-1 as ['NodeStatus'] 10/31/2024 02:29:18.872 7f3f53146f60 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.54 object_type = vrouter request_url = http://10.0.0.54:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 3829 response_size_objects = 1 response_size_bytes = 926 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-2181-1. >> 10/31/2024 02:30:20.158 7f3f53146f60 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnIuu71pDsE2fwxkh-MnkXS-8csFp9wfZ7wAiJP_s8iPCDnd_6vvBsgUZF3vQu89g150BEL8jgTnCQNmR3og-i0QuYhgbJOKGXUBZ_1ocxPRvU85XcniogQF_LwytTfPx3RiLqT8mZZhfGOgmzUBh1e8k2rQyyXThDImx_ClO_hIdWc80 10/31/2024 02:30:20.158 7f3f53146f60 [contrail-analytics-api] [DEBUG]: user resources are None 10/31/2024 02:30:20.162 7f3f53146f60 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-2181-1 as ['VrouterAgent'] 10/31/2024 02:30:20.162 7f3f53146eb8 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.54 object_type = vrouter request_url = http://10.0.0.54:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 3811 response_size_objects = 1 response_size_bytes = 104 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-2181-1. >> 10/31/2024 02:30:20.682 7f3f53146f60 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnIuu8aZKSJTgiiuJD5F69L_WfJ7NBW8i4cn6zqKnRngb5b2DhQXYL_QvCecIdvLOVFPL4JLfUvYwhb9RYIuSH0OYM5vWiFJjOpuFHOMREPWx0U2cXw-l9aERg9ev6OSi_6LFyeKoqZ3nxcxpzPAJelb8zUfSR5EmhQql9JN5xyGkG_tg 10/31/2024 02:30:20.682 7f3f53146f60 [contrail-analytics-api] [DEBUG]: user resources are None 10/31/2024 02:30:20.686 7f3f53146f60 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-2181-1 as ['NodeStatus'] 10/31/2024 02:30:20.687 7f3f58b12eb8 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.54 object_type = vrouter request_url = http://10.0.0.54:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 5018 response_size_objects = 1 response_size_bytes = 926 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-2181-1. >> 10/31/2024 02:31:21.256 7f3f58b12eb8 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnIuv58qezv6KMEPDUQSKvASYyCfsJL6BZX8cNKoZEdLG45ea2i0O0g7_2d3cfTeSz-9Cm3DDtp5QjMq6_QO5te0PoTQRUJlwWLBnwhd7GFctpcNgXoMmY95OsZhVVV7IpaVEcvWtWPyaiNUN_vVyNz3ciLhXTFAAYa-79Gc7fgsJNKKI 10/31/2024 02:31:21.256 7f3f58b12eb8 [contrail-analytics-api] [DEBUG]: user resources are None 10/31/2024 02:31:21.258 7f3f58b12eb8 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-2181-1 as ['VrouterAgent'] 10/31/2024 02:31:21.259 7f3f530e4cc0 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.54 object_type = vrouter request_url = http://10.0.0.54:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 2909 response_size_objects = 1 response_size_bytes = 104 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-2181-1. >> 10/31/2024 02:31:22.074 7f3f58b12eb8 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnIuv56aaoBMZU3oAdUJRStgdTX4Hl7MYVXOhtdklbrXDYHuqmfSyKP7Caeb6jJr7FEkz11VSFnReKk0jo5wNpiiVbL4GttZdJUs1PM-oKixHskCbdcI_gRoGR7iznwCzBjzk13ZyjccrhGEI9AfuyN3zadlx9ESVfdWeWcKJrMM6h_qY 10/31/2024 02:31:22.075 7f3f58b12eb8 [contrail-analytics-api] [DEBUG]: user resources are None 10/31/2024 02:31:22.079 7f3f58b12eb8 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-2181-1 as ['NodeStatus'] 10/31/2024 02:31:22.080 7f3f53142780 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.54 object_type = vrouter request_url = http://10.0.0.54:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 5040 response_size_objects = 1 response_size_bytes = 926 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-2181-1. >> 10/31/2024 02:32:23.265 7f3f58b12eb8 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnIuw3MsWZwFScx4h8rsfwVGngmjzLg3dtpr7GWGYC5ttZvyDZROfE6iCFE_-oPkKa5iRfFWFB2aXB87prgxupKVB3DmbNBD34zuLN44kU4VFGJZWwH2letnWBJry_CjAGotBdpIlHh1KO8vMPw1-1nWZ10VKy3fi7o9zCXxdOn4LxAd8 10/31/2024 02:32:23.265 7f3f58b12eb8 [contrail-analytics-api] [DEBUG]: user resources are None 10/31/2024 02:32:23.267 7f3f58b12eb8 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-2181-1 as ['VrouterAgent'] 10/31/2024 02:32:23.268 7f3f53169828 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.54 object_type = vrouter request_url = http://10.0.0.54:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 2983 response_size_objects = 1 response_size_bytes = 104 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-2181-1. >> 10/31/2024 02:32:23.727 7f3f58b12eb8 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABnIuw3m8DSQuFTf9vDfKWKT4jj7w14K_ipq-RHpNhkWBm9M5Ge2hXZ_my2Wqlbico1O8e_PDq7FNl2ETLcZiY7K_niQWKVUvRs3vMxHp9lZCM215wrhe42kobH2ICAyffPIRHTTSie0zOghKHQo5FFhMKKRQWgT1uiGkECoUbWh7uusbk 10/31/2024 02:32:23.727 7f3f58b12eb8 [contrail-analytics-api] [DEBUG]: user resources are None 10/31/2024 02:32:23.730 7f3f58b12eb8 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-2181-1 as ['NodeStatus'] 10/31/2024 02:32:23.731 7f3f55e46c18 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.54 object_type = vrouter request_url = http://10.0.0.54:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 3232 response_size_objects = 1 response_size_bytes = 926 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-2181-1. >> 10/31/2024 02:32:46.733 7f3f58b12eb8 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map