05/29/2025 02:27:05.606 7fcd27211b08 [contrail-analytics-api] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 05/29/2025 02:27:05.608 7fcd27211b08 [contrail-analytics-api] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 05/29/2025 02:27:05.608 7fcd27211b08 [contrail-analytics-api] [INFO]: SANDESH: Flow Logging: [None] -> [False] 05/29/2025 02:27:05.608 7fcd27211b08 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:NodeStatusUVE] map 05/29/2025 02:27:05.634 7fcd27211b08 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 05/29/2025 02:27:05.635 7fcd1db5c438 [contrail-analytics-api] [ERROR]: Cannot write http_port 8090 to /tmp/contrail-analytics-api.0.http_port 05/29/2025 02:27:05.636 7fcd1db5c438 [contrail-analytics-api] [ERROR]: Starting Introspect on HTTP Port 8090 05/29/2025 02:27:05.636 7fcd1db5dd68 [contrail-analytics-api] [INFO]: Processing event[EvStart] in state[none] 05/29/2025 02:27:05.636 7fcd1db5dd68 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 05/29/2025 02:27:05.637 7fcd1db5dd68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 05/29/2025 02:27:05.637 7fcd1db5dd68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:27:05.637 7fcd1db5dd68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3361-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.242:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, ] description = >>, ] >> 05/29/2025 02:27:05.638 7fcd1db5dd68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:27:05.638 7fcd1db5dd68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:27:05.638 7fcd1db5dd68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3361-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.242:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.242:6379 server_addrs = [ 10.0.0.242:6379, ] status = Initializing description = Redis Instance initialized >>, ] description = Redis-UVE:10.0.0.242:6379[Redis Instance initialized] connection down >>, ] >> 05/29/2025 02:27:05.638 7fcd1db5dd68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:27:05.638 7fcd1db5dd68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:27:05.638 7fcd1db5dd68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3361-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.242:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.242:6379 server_addrs = [ 10.0.0.242:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.242:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, ] description = Redis-UVE:10.0.0.242:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized] connection down >>, ] >> 05/29/2025 02:27:05.638 7fcd1db5dd68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:27:05.638 7fcd1db5dd68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:27:05.638 7fcd1db5dd68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] AnalyticsApiInfoUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3361-1. analytics_node_ip = { rest_api_ip : 10.0.0.242host_ip : 10.0.0.242 } >> 05/29/2025 02:27:05.638 7fcd1db5dd68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:27:05.638 7fcd1db5dd68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:27:05.639 7fcd1db5dd68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3361-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.242:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.242:6379 server_addrs = [ 10.0.0.242:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.242:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Redis-UVE:10.0.0.242:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 05/29/2025 02:27:05.639 7fcd1db5dd68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:27:05.639 7fcd1db5dd68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:27:05.639 7fcd1db5dd68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3361-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1748485625636654 collector_name = collector_ip = collector_list = [ 10.0.0.242:8086, ] >> sm_queue_count = 5 max_sm_queue_count = 5 >> 05/29/2025 02:27:05.640 7fcd1db5dd68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:27:05.641 7fcd24f6ac18 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 05/29/2025 02:27:05.651 7fcd239b6cc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:27:05.651 7fcd239b6cc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3361-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.242:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.242:6379 server_addrs = [ 10.0.0.242:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.242:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.242:8082, ] status = Initializing description = Connection to API Server initialized >>, ] description = Redis-UVE:10.0.0.242:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[Connection to API Server initialized] connection down >>, ] >> 05/29/2025 02:27:05.651 7fcd239b6cc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:27:05.656 7fcd2391b240 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:27:05.656 7fcd2391b240 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3361-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.242:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.242:6379 server_addrs = [ 10.0.0.242:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.242:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.242:8082, ] status = Initializing description = Connection to API Server initialized >>, ] description = Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[Connection to API Server initialized] connection down >>, ] >> 05/29/2025 02:27:05.656 7fcd2391b240 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:27:05.660 7fcd239b64e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:27:05.660 7fcd239b64e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3361-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.242:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.242:6379 server_addrs = [ 10.0.0.242:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.242:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.242:8082, ] status = Up description = Connection to API Server established >>, ] description = Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 05/29/2025 02:27:05.660 7fcd239b64e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:27:05.660 7fcd239818d0 [contrail-analytics-api] [INFO]: Analytics Discovery listen CONNECTED 05/29/2025 02:27:05.661 7fcd239818d0 [contrail-analytics-api] [INFO]: Analytics Discovery to publish None 05/29/2025 02:27:05.661 7fcd27279390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:27:05.662 7fcd27279390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3361-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.242:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.242:6379 server_addrs = [ 10.0.0.242:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.242:2181, ] status = Up description = Connection to Zookeeper re-established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.242:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 05/29/2025 02:27:05.662 7fcd27279390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:27:05.662 7fcd27279390 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:27:05.662 7fcd27279390 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3361-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.242:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.242:6379 server_addrs = [ 10.0.0.242:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.242:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.242:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 05/29/2025 02:27:05.662 7fcd27279390 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/29/2025 02:27:05.670 7fcd24f6ac18 [contrail-analytics-api] [INFO]: Analytics Discovery Watcher AlarmGenerator Children [] 05/29/2025 02:27:05.672 7fcd24f6ac18 [contrail-analytics-api] [INFO]: Analytics Discovery OpServer reconnect 05/29/2025 02:27:05.672 7fcd24f6ac18 [contrail-analytics-api] [INFO]: ensure /analytics-discovery-/OpServer 05/29/2025 02:27:05.672 7fcd24f6ac18 [contrail-analytics-api] [INFO]: zk state CONNECTED (CONNECTED) 05/29/2025 02:27:05.677 7fcd24f6ac18 [contrail-analytics-api] [INFO]: check for /analytics-discovery-/OpServer/cn-jenkins-deploy-platform-ansible-os-3361-1.-0 05/29/2025 02:27:09.639 7fcd2394d8d0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/29/2025 02:27:09.641 7fcd2394d8d0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 05/29/2025 02:27:09.641 7fcd2394d8d0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/29/2025 02:27:09.641 7fcd2394d8d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/29/2025 02:27:09.641 7fcd2394d8d0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3361-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.242:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.242:6379 server_addrs = [ 10.0.0.242:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.242:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.242:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/29/2025 02:27:09.641 7fcd2394d8d0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/29/2025 02:27:09.641 7fcd2394d8d0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 05/29/2025 02:27:09.641 7fcd2394d8d0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 05/29/2025 02:27:09.641 7fcd2394d8d0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 05/29/2025 02:27:09.642 7fcd2394d8d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 05/29/2025 02:27:09.642 7fcd2394d8d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 05/29/2025 02:27:09.642 7fcd2394d390 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 05/29/2025 02:27:09.643 7fcd2394d390 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 05/29/2025 02:27:09.646 7fcd1db5dac8 [contrail-analytics-api] [DEBUG]: Extracted sandesh length: 0000001017 05/29/2025 02:27:09.647 7fcd1db5dac8 [contrail-analytics-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 05/29/2025 02:27:09.647 7fcd1fc988d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 05/29/2025 02:27:09.647 7fcd1fc988d0 [contrail-analytics-api] [DEBUG]: Number of uve types in sandesh control message is 0 05/29/2025 02:27:09.647 7fcd1fc988d0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 05/29/2025 02:27:09.647 7fcd1fc988d0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 05/29/2025 02:27:09.647 7fcd1fc988d0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 05/29/2025 02:27:09.647 7fcd1fc988d0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 05/29/2025 02:27:09.648 7fcd2394d390 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 05/29/2025 02:27:09.649 7fcd2394d390 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 05/29/2025 02:27:11.866 7fcd1fc988d0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoN8X_ZrqrhjQhzbwCkbPDYiiUEUKnz6dJl4F_sWino9KjN8oq3ayyd7Eb9BpXYoH1eBtFlLiI76ZR1SGnfJ9j3wywm-Dj92X-EzKzH9BI0RY5CYKpXx0c9jKDJtfg4A_bGEPBgoAOKtUAGuXptqaNGo9WA4nzrZDt92HlgQnLZk1d4ps 05/29/2025 02:27:11.866 7fcd1fc988d0 [contrail-analytics-api] [DEBUG]: user resources are None 05/29/2025 02:27:11.868 7fcd2397e978 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.242 object_type = vrouter request_url = http://10.0.0.242:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 1928 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3361-1. >> 05/29/2025 02:27:12.221 7fcd1fc988d0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoN8YASx0iVYjiQCWHt1Z5UmBVjUB_gmC3C2890nMr01Ht8vokI51A9xThD_nOFLNoPRwcFh1HKNEScj6gBfunHvVKRqEhwIbfvBUrL_j4J8ngRJH951D8meRPfU77d2gqlPf3CziDKJQYf9Zb6JGE3WYOVjCqcZ1FUAtAadltIAoWOtQ 05/29/2025 02:27:12.221 7fcd1fc988d0 [contrail-analytics-api] [DEBUG]: user resources are None 05/29/2025 02:27:12.223 7fcd27092390 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.242 object_type = vrouter request_url = http://10.0.0.242:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 1655 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3361-1. >> 05/29/2025 02:27:17.158 7fcd1db5dac8 [contrail-analytics-api] [DEBUG]: Extracted sandesh length: 0000001436 05/29/2025 02:27:17.158 7fcd1db5dac8 [contrail-analytics-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 05/29/2025 02:27:17.158 7fcd1d755d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 05/29/2025 02:27:17.159 7fcd1d755d68 [contrail-analytics-api] [DEBUG]: Number of uve types in sandesh control message is 3 05/29/2025 02:27:17.159 7fcd1d755d68 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 05/29/2025 02:27:17.159 7fcd1d755d68 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 05/29/2025 02:27:17.159 7fcd1d755d68 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 05/29/2025 02:27:17.159 7fcd27092390 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 05/29/2025 02:27:17.159 7fcd27092390 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 05/29/2025 02:27:20.299 7fcd23981780 [contrail-analytics-api] [INFO]: Analytics Discovery Watcher AlarmGenerator Children ['cn-jenkins-deploy-platform-ansible-os-3361-1.-0'] 05/29/2025 02:27:25.681 7fcd24f6ac18 [contrail-analytics-api] [INFO]: Analytics Discovery OpServer reconnect 05/29/2025 02:27:25.681 7fcd24f6ac18 [contrail-analytics-api] [INFO]: ensure /analytics-discovery-/OpServer 05/29/2025 02:27:25.681 7fcd24f6ac18 [contrail-analytics-api] [INFO]: zk state CONNECTED (CONNECTED) 05/29/2025 02:27:25.683 7fcd24f6ac18 [contrail-analytics-api] [INFO]: check for /analytics-discovery-/OpServer/cn-jenkins-deploy-platform-ansible-os-3361-1.-0 05/29/2025 02:27:25.687 7fcd24f6ac18 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-3361-1.-0, data b'{"ip-address": "10.0.0.242", "instance-id": "0", "redis-ip": "10.0.0.242", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{}"}', event None 05/29/2025 02:27:25.688 7fcd24f6ac18 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-3361-1.-0, data OrderedDict([('instance-id', '0'), ('ip-address', '10.0.0.242'), ('partitions', '{}'), ('redis-agg-db', 7), ('redis-ip', '10.0.0.242'), ('redis-port', '6379')]), event GET 05/29/2025 02:27:29.501 7fcd23981780 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-3361-1.-0, data b'{"ip-address": "10.0.0.242", "instance-id": "0", "redis-ip": "10.0.0.242", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{}"}', event WatchedEvent(type='CHANGED', state='CONNECTED', path='/analytics-discovery-/AlarmGenerator/cn-jenkins-deploy-platform-ansible-os-3361-1.-0') 05/29/2025 02:27:30.385 7fcd23981780 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-3361-1.-0, data b'{"ip-address": "10.0.0.242", "instance-id": "0", "redis-ip": "10.0.0.242", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{\\"0\\": 1748485649739687, \\"1\\": 1748485649750493, \\"2\\": 1748485649765883, \\"3\\": 1748485649778010, \\"4\\": 1748485649789009, \\"5\\": 1748485649804173, \\"6\\": 1748485649817951, \\"7\\": 1748485649837620, \\"8\\": 1748485649848295, \\"9\\": 1748485649865046, \\"10\\": 1748485649883417, \\"11\\": 1748485649904178, \\"12\\": 1748485649912749, \\"13\\": 1748485649931000, \\"14\\": 1748485649946039, \\"15\\": 1748485649961994, \\"16\\": 1748485649983350, \\"17\\": 1748485650001916, \\"18\\": 1748485650018848, \\"19\\": 1748485650040342, \\"20\\": 1748485650071049, \\"21\\": 1748485650083771, \\"22\\": 1748485650097395, \\"23\\": 1748485650126170, \\"24\\": 1748485650142781, \\"25\\": 1748485650157194, \\"26\\": 1748485650200291, \\"27\\": 1748485650211680, \\"28\\": 1748485650226266, \\"29\\": 1748485650250524}"}', event WatchedEvent(type='CHANGED', state='CONNECTED', path='/analytics-discovery-/AlarmGenerator/cn-jenkins-deploy-platform-ansible-os-3361-1.-0') 05/29/2025 02:28:12.574 7fcd2397e828 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoN8Y8q2GS5TCIAEfx4STetJYRzG2nQe_q5qVjA4MFTMwe_TVpTmkiiW1Z0iaaRVJVtLvM1eYrsUqJQuJLKR1_e6GTGpLcnrBsaxFqfgo7XeKYQQyWb8ccTzjLbcTsr9CGT5BoktjvNQMLgH13akloXav1qpyMGQe_rs-IyT_UYoUt7QI 05/29/2025 02:28:12.574 7fcd2397e828 [contrail-analytics-api] [DEBUG]: user resources are None 05/29/2025 02:28:12.576 7fcd2394da20 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.242 object_type = vrouter request_url = http://10.0.0.242:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 1752 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3361-1. >> 05/29/2025 02:28:12.917 7fcd2397e828 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoN8Y8nwrOVYFQTrh0eMkIJf3Yc-IERs9hRZVYqtIuFWMTF4Yao-Cz3TG68aRuAF51eP7dOVaMq-Q-d_8HsaE8Q3JUEu1WWgmN9itimIumtCmQPRPzC10_l3hgktd8reC8WVd03LqAz8Cl8AlorR-5M7vDg5an0trwn6zCbNzlPv1W2xQ 05/29/2025 02:28:12.917 7fcd2397e828 [contrail-analytics-api] [DEBUG]: user resources are None 05/29/2025 02:28:12.918 7fcd1fc988d0 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.242 object_type = vrouter request_url = http://10.0.0.242:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 909 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3361-1. >> 05/29/2025 02:29:02.228 7fcd2397e828 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 05/29/2025 02:29:04.343 7fcd2397e828 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 05/29/2025 02:29:13.258 7fcd2397e828 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoN8Z5ihtR8URxmMnUnUDAg8zFhpEEIiYpEj89IiyjaMO4REkiEGZEkFBRq05TpHTIiq706aLo1pvg4zXpECCkLgLl-vjzPCAZXQGAGvXch_gyW02NNLI-0FB4S1SOrEBfjz3pHvEG7JzHGhuMmDmyLHGZeq9dIAoInHGrLgYUczmioi8 05/29/2025 02:29:13.258 7fcd2397e828 [contrail-analytics-api] [DEBUG]: user resources are None 05/29/2025 02:29:13.260 7fcd2397ef60 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.242 object_type = vrouter request_url = http://10.0.0.242:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 1023 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3361-1. >> 05/29/2025 02:29:13.601 7fcd2397e828 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoN8Z56xKEcz4NigV-djiJMCzXlt5F95Zb1xwZFEzYiYqgmI8hH34J1s1vT9ljiiOM2vyVQ0p5jHt2zkyiOItUoH3BUF9zs6AruXsAOq8lz9MVi0IboVgvl7gDRk1DCjLnRFkL0qgsnn7So8HZxNXBDLxQzDzEqey8Taay_KAl3n7nqtQ 05/29/2025 02:29:13.601 7fcd2397e828 [contrail-analytics-api] [DEBUG]: user resources are None 05/29/2025 02:29:13.604 7fcd2397e828 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3361-1 as ['NodeStatus'] 05/29/2025 02:29:13.605 7fcd27236d68 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.242 object_type = vrouter request_url = http://10.0.0.242:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 2856 response_size_objects = 1 response_size_bytes = 928 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3361-1. >> 05/29/2025 02:30:14.393 7fcd2397e828 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoN8a2o5iO76NtrslytBK43Y3y8atTpo7PRRmX0_K5_TLVoK5Uq9e97UnqtM9Jh2US9qhbBS_1BvUounUVeXrBAzMxX_HaG2Jj5fLbDQkGgGZIlFLeAO7faG44yYO2sacgmiLObUY9AwF402CtqXd5cdkUoNouTLH5OQPDCSQbpPVa-a4 05/29/2025 02:30:14.393 7fcd2397e828 [contrail-analytics-api] [DEBUG]: user resources are None 05/29/2025 02:30:14.395 7fcd2397e828 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3361-1 as ['VrouterAgent'] 05/29/2025 02:30:14.396 7fcd1fc988d0 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.242 object_type = vrouter request_url = http://10.0.0.242:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 2605 response_size_objects = 1 response_size_bytes = 104 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3361-1. >> 05/29/2025 02:30:14.773 7fcd2397e828 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoN8a292veIqnVa2ZB0pVpQGqIczMa1KNUkgkGouKpH0aQLjsUVSVIaC7NQ8p5gqLwMHYwcovgFAJiAxPKRis-gk95lg0lka7YNqrxbf2RiATe8rgj3RxXpnxwguoY4TAr53EOYHRz_Wqq-FSVqCimZHQOkZpu8iUB20UJVbdvgYePYlY 05/29/2025 02:30:14.774 7fcd2397e828 [contrail-analytics-api] [DEBUG]: user resources are None 05/29/2025 02:30:14.776 7fcd2397e828 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3361-1 as ['NodeStatus'] 05/29/2025 02:30:14.776 7fcd2394b8d0 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.242 object_type = vrouter request_url = http://10.0.0.242:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 2642 response_size_objects = 1 response_size_bytes = 928 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3361-1. >> 05/29/2025 02:30:25.985 7fcd2397e828 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 05/29/2025 02:30:26.554 7fcd2397e828 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 05/29/2025 02:31:15.150 7fcd2397e828 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoN8bzRerBfQtgcGe_6RuXo6S8iuRbOCqRwp3BBlNj587L_uH6oexmdI9OM1EOuSa-2tiFyNhZUzTutzBCjkT-rf1UUyYBogEr6eZj9YYW2qJVmqVYzvEkp80kl2Spl87WX04vBWKk3oDQovl3OZzIsHkykg6k6GwstK3yHxivjVDkEjM 05/29/2025 02:31:15.150 7fcd2397e828 [contrail-analytics-api] [DEBUG]: user resources are None 05/29/2025 02:31:15.153 7fcd2397e828 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3361-1 as ['VrouterAgent'] 05/29/2025 02:31:15.153 7fcd23981f60 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.242 object_type = vrouter request_url = http://10.0.0.242:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 3290 response_size_objects = 1 response_size_bytes = 104 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3361-1. >> 05/29/2025 02:31:15.501 7fcd2397e828 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoN8bzTObegHT_LE7HF1a_LY2HZG8CkneCaOTzmlzvlFHAstgp0EooDh46pTte4JuzZA26UwbgbtWcIZxkDJFHoVaAsN2U8QElxHNfk1xfUTa4rfP1-6C76TWfhahvuxoXYEUmOPGmNiKSy0P9nTuW7aN0VXLHPpcJX2J3PSZNtQcJ5g4 05/29/2025 02:31:15.501 7fcd2397e828 [contrail-analytics-api] [DEBUG]: user resources are None 05/29/2025 02:31:15.503 7fcd2397e828 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3361-1 as ['NodeStatus'] 05/29/2025 02:31:15.504 7fcd239b9438 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.242 object_type = vrouter request_url = http://10.0.0.242:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 2926 response_size_objects = 1 response_size_bytes = 928 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3361-1. >> 05/29/2025 02:32:14.862 7fcd27279390 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 05/29/2025 02:32:16.645 7fcd27279390 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoN8cwqDCmdDqkZn0Z88PvgwjX9mwqwl4RuO5Tggn6k_IMYn37c-WNjVR0kxlYOvrFIsH46jo7rcMnBCWpTDLVxdiDZX3GvyhtFYOPKMxxkracPFpBmWMsiQSV4hD4SGvPJQkKKRETRRTLF1kIDT0uP_0EDM3kKnZDCmMv7rKLLHZ0Wxw 05/29/2025 02:32:16.646 7fcd27279390 [contrail-analytics-api] [DEBUG]: user resources are None 05/29/2025 02:32:16.648 7fcd27279390 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3361-1 as ['VrouterAgent'] 05/29/2025 02:32:16.649 7fcd2397e198 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.242 object_type = vrouter request_url = http://10.0.0.242:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 3555 response_size_objects = 1 response_size_bytes = 104 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3361-1. >> 05/29/2025 02:32:17.000 7fcd27279390 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoN8cwDqAdf0nuHyRNhD3AyWefD60xRnJohy5C18W_SOPH3IRCj7Oy7WJjEOo1EPs2nW2dCENMnQb_ib846o2r5bK3hpUBVqa6niaj5G4NAEhtcd8ToBi74N43_AxhAO4_XqJXD1gDkV1oqb3biHOf842IQW6EnumCrf2nzhU1BlSr-ZQ 05/29/2025 02:32:17.001 7fcd27279390 [contrail-analytics-api] [DEBUG]: user resources are None 05/29/2025 02:32:17.003 7fcd27279390 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3361-1 as ['NodeStatus'] 05/29/2025 02:32:17.006 7fcd23949588 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.242 object_type = vrouter request_url = http://10.0.0.242:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 2710 response_size_objects = 1 response_size_bytes = 928 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3361-1. >>