06/19/2025 02:14:08.730 7f951606b8c8 [contrail-analytics-api] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 06/19/2025 02:14:08.730 7f951606b8c8 [contrail-analytics-api] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 06/19/2025 02:14:08.730 7f951606b8c8 [contrail-analytics-api] [INFO]: SANDESH: Flow Logging: [None] -> [False] 06/19/2025 02:14:08.731 7f951606b8c8 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/19/2025 02:14:08.761 7f951606b8c8 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 06/19/2025 02:14:08.762 7f950e3c0438 [contrail-analytics-api] [ERROR]: Cannot write http_port 8090 to /tmp/contrail-analytics-api.0.http_port 06/19/2025 02:14:08.763 7f950e3c0438 [contrail-analytics-api] [ERROR]: Starting Introspect on HTTP Port 8090 06/19/2025 02:14:08.763 7f950e3c4d68 [contrail-analytics-api] [INFO]: Processing event[EvStart] in state[none] 06/19/2025 02:14:08.764 7f950e3c4d68 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 06/19/2025 02:14:08.764 7f950e3c4d68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 06/19/2025 02:14:08.766 7f950e3c4d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 02:14:08.766 7f950e3c4d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3482-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.27:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, ] description = >>, ] >> 06/19/2025 02:14:08.767 7f950e3c4d68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 02:14:08.767 7f950e3c4d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 02:14:08.767 7f950e3c4d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3482-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.27:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.27:6379 server_addrs = [ 10.0.0.27:6379, ] status = Initializing description = Redis Instance initialized >>, ] description = Redis-UVE:10.0.0.27:6379[Redis Instance initialized] connection down >>, ] >> 06/19/2025 02:14:08.767 7f950e3c4d68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 02:14:08.767 7f950e3c4d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 02:14:08.767 7f950e3c4d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3482-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.27:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.27:6379 server_addrs = [ 10.0.0.27:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.27:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, ] description = Redis-UVE:10.0.0.27:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized] connection down >>, ] >> 06/19/2025 02:14:08.767 7f950e3c4d68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 02:14:08.767 7f950e3c4d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 02:14:08.767 7f950e3c4d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] AnalyticsApiInfoUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3482-1. analytics_node_ip = { rest_api_ip : 10.0.0.27host_ip : 10.0.0.27 } >> 06/19/2025 02:14:08.767 7f950e3c4d68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 02:14:08.767 7f950e3c4d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 02:14:08.767 7f950e3c4d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3482-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.27:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.27:6379 server_addrs = [ 10.0.0.27:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.27:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Redis-UVE:10.0.0.27:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 06/19/2025 02:14:08.768 7f950e3c4d68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 02:14:08.769 7f950e3c4d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 02:14:08.769 7f950e3c4d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3482-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1750299248764152 collector_name = collector_ip = collector_list = [ 10.0.0.27:8086, ] >> sm_queue_count = 5 max_sm_queue_count = 5 >> 06/19/2025 02:14:08.769 7f950e3c4d68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 02:14:08.769 7f9513d0fc18 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 06/19/2025 02:14:08.778 7f95127d9eb8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 02:14:08.778 7f95127d9eb8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3482-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.27:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.27:6379 server_addrs = [ 10.0.0.27:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.27:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.27:8082, ] status = Initializing description = Connection to API Server initialized >>, ] description = Redis-UVE:10.0.0.27:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[Connection to API Server initialized] connection down >>, ] >> 06/19/2025 02:14:08.779 7f95127d9eb8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 02:14:08.783 7f95127410f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 02:14:08.784 7f95127410f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3482-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.27:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.27:6379 server_addrs = [ 10.0.0.27:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.27:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.27:8082, ] status = Initializing description = Connection to API Server initialized >>, ] description = Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[Connection to API Server initialized] connection down >>, ] >> 06/19/2025 02:14:08.784 7f95127410f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 02:14:08.789 7f9515aa2b70 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 02:14:08.789 7f9515aa2b70 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3482-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.27:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.27:6379 server_addrs = [ 10.0.0.27:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.27:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.27:8082, ] status = Up description = Connection to API Server established >>, ] description = Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 06/19/2025 02:14:08.789 7f9515aa2b70 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 02:14:08.790 7f95127a48d0 [contrail-analytics-api] [INFO]: Analytics Discovery listen CONNECTED 06/19/2025 02:14:08.790 7f95127a48d0 [contrail-analytics-api] [INFO]: Analytics Discovery to publish None 06/19/2025 02:14:08.790 7f9516034b70 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 02:14:08.790 7f9516034b70 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3482-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.27:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.27:6379 server_addrs = [ 10.0.0.27:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.27:2181, ] status = Up description = Connection to Zookeeper re-established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.27:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 06/19/2025 02:14:08.790 7f9516034b70 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 02:14:08.791 7f9516034b70 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 02:14:08.791 7f9516034b70 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3482-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.27:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.27:6379 server_addrs = [ 10.0.0.27:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.27:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.27:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 06/19/2025 02:14:08.791 7f9516034b70 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 02:14:08.801 7f9513d0fc18 [contrail-analytics-api] [INFO]: Analytics Discovery Watcher AlarmGenerator Children [] 06/19/2025 02:14:08.803 7f9513d0fc18 [contrail-analytics-api] [INFO]: Analytics Discovery OpServer reconnect 06/19/2025 02:14:08.804 7f9513d0fc18 [contrail-analytics-api] [INFO]: ensure /analytics-discovery-/OpServer 06/19/2025 02:14:08.804 7f9513d0fc18 [contrail-analytics-api] [INFO]: zk state CONNECTED (CONNECTED) 06/19/2025 02:14:08.808 7f9513d0fc18 [contrail-analytics-api] [INFO]: check for /analytics-discovery-/OpServer/cn-jenkins-deploy-platform-ansible-os-3482-1.-0 06/19/2025 02:14:12.767 7f951276f8d0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 02:14:12.769 7f951276f8d0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 06/19/2025 02:14:12.769 7f951276f8d0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 02:14:12.769 7f951276f8d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 02:14:12.769 7f951276f8d0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3482-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.27:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.27:6379 server_addrs = [ 10.0.0.27:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.27:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.27:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/19/2025 02:14:12.769 7f951276f8d0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 02:14:12.769 7f951276f8d0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 06/19/2025 02:14:12.769 7f951276f8d0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 06/19/2025 02:14:12.769 7f951276f8d0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 06/19/2025 02:14:12.769 7f951276f8d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 06/19/2025 02:14:12.770 7f951276f8d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 06/19/2025 02:14:12.770 7f951276f390 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 06/19/2025 02:14:12.771 7f951276f390 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 06/19/2025 02:14:12.773 7f950e3c4ac8 [contrail-analytics-api] [DEBUG]: Extracted sandesh length: 0000001017 06/19/2025 02:14:12.774 7f950e3c4ac8 [contrail-analytics-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 06/19/2025 02:14:12.774 7f950d8258d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 06/19/2025 02:14:12.774 7f950d8258d0 [contrail-analytics-api] [DEBUG]: Number of uve types in sandesh control message is 0 06/19/2025 02:14:12.774 7f950d8258d0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 06/19/2025 02:14:12.774 7f950d8258d0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/19/2025 02:14:12.774 7f950d8258d0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 06/19/2025 02:14:12.775 7f950d8258d0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 06/19/2025 02:14:12.775 7f951276f390 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 06/19/2025 02:14:12.776 7f951276f390 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 06/19/2025 02:14:17.348 7f950d8258d0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoU3J46fuJNiuEdOXWQoiS9FjgHQc9jkc_aBXXKs41Bius-MXSudvL7cvTvxam4bF1rwQs-8TB4yo9eBVYxSspxWKn6qYJSAx18s-HehKUGE7x3llw03bzoPdPmXdp3ETrwRQ0r6wwGcKb6jvM6Bn61acfJb-0E0MP_8VE43bsFfFYbNc 06/19/2025 02:14:17.348 7f950d8258d0 [contrail-analytics-api] [DEBUG]: user resources are None 06/19/2025 02:14:17.349 7f95127a1978 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.27 object_type = vrouter request_url = http://10.0.0.27:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 1054 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3482-1. >> 06/19/2025 02:14:17.687 7f950d8258d0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoU3J5BxSriQrh8Y4CuLLg7xR9M2MlI_TdiVsDtwak9b6VkgFJsJUbMoDALOz6lEE8IJWMBKQC31-EUwvDtrNnowH2do3p-ePwCZ7_oj1BmOkal6m9JvHfga5SpsdaNvSMcPFNt7DVKgRGzLcIvRipvqC7ZvO-DmIxdzbEDeMKbFdoZrI 06/19/2025 02:14:17.687 7f950d8258d0 [contrail-analytics-api] [DEBUG]: user resources are None 06/19/2025 02:14:17.688 7f950c5798d0 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.27 object_type = vrouter request_url = http://10.0.0.27:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 980 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3482-1. >> 06/19/2025 02:14:20.498 7f950e3c4ac8 [contrail-analytics-api] [DEBUG]: Extracted sandesh length: 0000001436 06/19/2025 02:14:20.499 7f950e3c4ac8 [contrail-analytics-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 06/19/2025 02:14:20.499 7f950c579d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 06/19/2025 02:14:20.499 7f950c579d68 [contrail-analytics-api] [DEBUG]: Number of uve types in sandesh control message is 3 06/19/2025 02:14:20.499 7f950c579d68 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 06/19/2025 02:14:20.499 7f950c579d68 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/19/2025 02:14:20.499 7f950c579d68 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 06/19/2025 02:14:20.500 7f950c5798d0 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 06/19/2025 02:14:20.500 7f950c5798d0 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 06/19/2025 02:14:23.206 7f95127a4780 [contrail-analytics-api] [INFO]: Analytics Discovery Watcher AlarmGenerator Children ['cn-jenkins-deploy-platform-ansible-os-3482-1.-0'] 06/19/2025 02:14:28.812 7f9513d0fc18 [contrail-analytics-api] [INFO]: Analytics Discovery OpServer reconnect 06/19/2025 02:14:28.812 7f9513d0fc18 [contrail-analytics-api] [INFO]: ensure /analytics-discovery-/OpServer 06/19/2025 02:14:28.812 7f9513d0fc18 [contrail-analytics-api] [INFO]: zk state CONNECTED (CONNECTED) 06/19/2025 02:14:28.813 7f9513d0fc18 [contrail-analytics-api] [INFO]: check for /analytics-discovery-/OpServer/cn-jenkins-deploy-platform-ansible-os-3482-1.-0 06/19/2025 02:14:28.816 7f9513d0fc18 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-3482-1.-0, data b'{"ip-address": "10.0.0.27", "instance-id": "0", "redis-ip": "10.0.0.27", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{}"}', event None 06/19/2025 02:14:28.817 7f9513d0fc18 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-3482-1.-0, data OrderedDict([('instance-id', '0'), ('ip-address', '10.0.0.27'), ('partitions', '{}'), ('redis-agg-db', 7), ('redis-ip', '10.0.0.27'), ('redis-port', '6379')]), event GET 06/19/2025 02:14:32.404 7f95127a4780 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-3482-1.-0, data b'{"ip-address": "10.0.0.27", "instance-id": "0", "redis-ip": "10.0.0.27", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{}"}', event WatchedEvent(type='CHANGED', state='CONNECTED', path='/analytics-discovery-/AlarmGenerator/cn-jenkins-deploy-platform-ansible-os-3482-1.-0') 06/19/2025 02:14:33.313 7f95127a4780 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-3482-1.-0, data b'{"ip-address": "10.0.0.27", "instance-id": "0", "redis-ip": "10.0.0.27", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{\\"0\\": 1750299272626859, \\"1\\": 1750299272630489, \\"2\\": 1750299272642998, \\"3\\": 1750299272674471, \\"4\\": 1750299272705395, \\"5\\": 1750299272724332, \\"6\\": 1750299272740569, \\"7\\": 1750299272766592, \\"8\\": 1750299272781974, \\"9\\": 1750299272803597, \\"10\\": 1750299272825708, \\"11\\": 1750299272834578, \\"12\\": 1750299272849749, \\"13\\": 1750299272873301, \\"14\\": 1750299272899410, \\"15\\": 1750299272913537, \\"16\\": 1750299272932808, \\"17\\": 1750299272957825, \\"18\\": 1750299272982212, \\"19\\": 1750299273005910, \\"20\\": 1750299273022114, \\"21\\": 1750299273038376, \\"22\\": 1750299273057733, \\"23\\": 1750299273081487, \\"24\\": 1750299273090896, \\"25\\": 1750299273125301, \\"26\\": 1750299273142602, \\"27\\": 1750299273165842, \\"28\\": 1750299273174567, \\"29\\": 1750299273186872}"}', event WatchedEvent(type='CHANGED', state='CONNECTED', path='/analytics-discovery-/AlarmGenerator/cn-jenkins-deploy-platform-ansible-os-3482-1.-0') 06/19/2025 02:15:18.026 7f95127a1828 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoU3K1x7PQvgVrHIqUxq2FxlaR2M_a5C67VVbAqV_QRU-e05r9vwhFIkvQutuhxvrtDv0G-NC_qVorC_jAAVQFBs59dSTFTHVitq2b0bDPuhLjv7quD9uuKfehFPQH0pgXBPKbD1TMv_Depa9KfRPhUPvwzhJNQdZTirVULiUXTPf2rVA 06/19/2025 02:15:18.026 7f95127a1828 [contrail-analytics-api] [DEBUG]: user resources are None 06/19/2025 02:15:18.027 7f951276fa20 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.27 object_type = vrouter request_url = http://10.0.0.27:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 923 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3482-1. >> 06/19/2025 02:15:18.372 7f95127a1828 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoU3K27GKbGNh7tyTzf6ojR3ETVinolEF7-OLQXxS7Egyr8xWn2AZ-o5otfjG8Bxr7fE67y-F-4mjukVqyL4EzigBTUoBeQExJ0GqjLZ0HuvGN538h5e_Ch_h1-GdbB1FIlnFC2P1rKMmmX0aczyep0u8THj5hrP34kZQAIVxHjrpYhyI 06/19/2025 02:15:18.372 7f95127a1828 [contrail-analytics-api] [DEBUG]: user resources are None 06/19/2025 02:15:18.373 7f950d8258d0 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.27 object_type = vrouter request_url = http://10.0.0.27:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 726 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3482-1. >> 06/19/2025 02:16:02.232 7f95127a1828 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/19/2025 02:16:04.263 7f95127a1828 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/19/2025 02:16:18.708 7f95127a1828 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoU3LyIg15WZ_9l1L6hgp-Xlu7KmNn2kZXRyW98BeQK43vHt3nNBUzzRJ7CCfH5SwAqgWslMzt0RLhOZLbw0Jq6Tk0WY2hnyhQq3tgJ64bolWs9F2LFjXIKSsV4yyBGl3AVmU05YS-1aTpgrFRDagGZtxBhy3XQ5KgBAWTB5LXB2xBCSo 06/19/2025 02:16:18.708 7f95127a1828 [contrail-analytics-api] [DEBUG]: user resources are None 06/19/2025 02:16:18.709 7f95127a1198 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.27 object_type = vrouter request_url = http://10.0.0.27:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 894 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3482-1. >> 06/19/2025 02:16:19.046 7f95127a1828 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoU3Lyr75D-QwvGAPXl5PyBYZEh25S5z0wuWLcCmcs6klh1I4kLAAYoRgXdAxuRhIiJgZL5KSAXxA7KBBXdLtdcbtWMnaRQjDw2iCWzjDvbyZUBDyuhuPObfVWreYkAcRfGu7En5h5dej9KqHUBj54DYXXdrOctcDJVouODSB3_9CzupA 06/19/2025 02:16:19.046 7f95127a1828 [contrail-analytics-api] [DEBUG]: user resources are None 06/19/2025 02:16:19.048 7f95127a1828 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3482-1 as ['NodeStatus'] 06/19/2025 02:16:19.048 7f9516068b70 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.27 object_type = vrouter request_url = http://10.0.0.27:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 2328 response_size_objects = 1 response_size_bytes = 930 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3482-1. >> 06/19/2025 02:17:19.829 7f95127a1828 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoU3MvHAaU9MOeaabL9hbw6ox1PiRD914oCUtmeo_vowFYQ7Tij5jv0P3TOdvL7PT1gXwKPpo0-hGRRU1jvrh1Di0eoEHPynYQaNhjGVuCWCJ4x1cumr2YzhedzJRie7EAgQwDs_VPkKI2kkOqadSAJJr1Id7C49LMBbUMdk0zB1mJQ0M 06/19/2025 02:17:19.829 7f95127a1828 [contrail-analytics-api] [DEBUG]: user resources are None 06/19/2025 02:17:19.831 7f95127a1828 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3482-1 as ['VrouterAgent'] 06/19/2025 02:17:19.831 7f95127a4b70 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.27 object_type = vrouter request_url = http://10.0.0.27:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 1902 response_size_objects = 1 response_size_bytes = 104 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3482-1. >> 06/19/2025 02:17:20.477 7f95127a1828 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoU3MwSiJtMCZSjcU8XXvrltDpN6yp93SNYLeGzrzva8sQy6zhPks9zELRLN9g_6gan3MZ3X_5RQjRFfmyVJ50jRVfRS5jWVHTvs_2RA8pkHZPMTBANUqV7iKyIGvStCIdgVMGZBF5TymNjEPGknNrM1Db_jXelaou7uR4rhs6513mGe4 06/19/2025 02:17:20.478 7f95127a1828 [contrail-analytics-api] [DEBUG]: user resources are None 06/19/2025 02:17:20.480 7f95127a1828 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3482-1 as ['NodeStatus'] 06/19/2025 02:17:20.480 7f951276e630 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.27 object_type = vrouter request_url = http://10.0.0.27:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 2601 response_size_objects = 1 response_size_bytes = 930 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3482-1. >> 06/19/2025 02:17:29.869 7f951276e630 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 06/19/2025 02:17:30.614 7f951276e630 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 06/19/2025 02:18:20.887 7f951276e630 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoU3Ns9g34B9DcALoBFa_dLjGy68X6TkYrjbPiXQ_mi3Yk4Zvur7ukw2Ju5lOYspX9NDukxVwxrHqRqy5jENMgKq3wDA2-w3yysORucjft2L6FMtmVEF0R8CNaCNqJJM2icNe9jW6qCwVYi5_QWGgIdmQe2b_a0WOnLSrFeClU1gru230 06/19/2025 02:18:20.887 7f951276e630 [contrail-analytics-api] [DEBUG]: user resources are None 06/19/2025 02:18:20.889 7f951276e630 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3482-1 as ['VrouterAgent'] 06/19/2025 02:18:20.889 7f95127a40f0 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.27 object_type = vrouter request_url = http://10.0.0.27:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 1990 response_size_objects = 1 response_size_bytes = 104 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3482-1. >> 06/19/2025 02:18:21.560 7f951276e630 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoU3NtzCQRBnqmdz05H906HFiFdQid0eECsm4RvfOPGMSkPdcL8Z8b5ldZGli97-BhmFW-osb9xVeKALnm3C3SStqu4sW63ImcaUY2yL9Futt6U57yAAWCSZRXv75pjV2BJ-oP8b7mPuT9ohM2G_Le1vQ_slshE3rTr8sR7B-_fHvgf54 06/19/2025 02:18:21.560 7f951276e630 [contrail-analytics-api] [DEBUG]: user resources are None 06/19/2025 02:18:21.562 7f951276e630 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3482-1 as ['NodeStatus'] 06/19/2025 02:18:21.563 7f951276fe10 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.27 object_type = vrouter request_url = http://10.0.0.27:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 2599 response_size_objects = 1 response_size_bytes = 930 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3482-1. >> 06/19/2025 02:19:23.511 7f9516034b70 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoU3Or7u3-ty7safa8kixjrYFBdtlBB41QOwbgRQXIUwaU6LhRuOFKe8gmPCtfPTtkIUSCJxrKdjtEL4sTd4kUxDFP24cSM5z6ieAahA3tcSSlXZlGLiqLZmEKQDV6is-DSPIuvEJ0WCEBE9DBVYZ7qaTOTolY8EypCdVQdzKcaY-ahK0 06/19/2025 02:19:23.511 7f9516034b70 [contrail-analytics-api] [DEBUG]: user resources are None 06/19/2025 02:19:23.513 7f9516034b70 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3482-1 as ['VrouterAgent'] 06/19/2025 02:19:23.513 7f95127dc0f0 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.27 object_type = vrouter request_url = http://10.0.0.27:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 1993 response_size_objects = 1 response_size_bytes = 104 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3482-1. >> 06/19/2025 02:19:23.849 7f9516034b70 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoU3OrDwuuzYWghnqc1tjKLhqUKT23eHW8SU05xkBmeJqXiAk90GF5FSnhGSTM-AUsAmo6xan3j2ykyUouF-p5otOB4dY46Q3UkAwCOZ5Ds7g6_7HufHI9M-lpaLfofPpH3goxCij0yhXz_qhSLbzn4Yeov2KLCaDnlvchffs3GzeCeZA 06/19/2025 02:19:23.849 7f9516034b70 [contrail-analytics-api] [DEBUG]: user resources are None 06/19/2025 02:19:23.851 7f9516034b70 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3482-1 as ['NodeStatus'] 06/19/2025 02:19:23.851 7f951276c0f0 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.27 object_type = vrouter request_url = http://10.0.0.27:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 2358 response_size_objects = 1 response_size_bytes = 930 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3482-1. >> 06/19/2025 02:19:24.185 7f9516034b70 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map