05/15/2025 02:00:08.211 7fb08bf2ecc8 [contrail-analytics-api] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 05/15/2025 02:00:08.211 7fb08bf2ecc8 [contrail-analytics-api] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 05/15/2025 02:00:08.211 7fb08bf2ecc8 [contrail-analytics-api] [INFO]: SANDESH: Flow Logging: [None] -> [False] 05/15/2025 02:00:08.212 7fb08bf2ecc8 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:NodeStatusUVE] map 05/15/2025 02:00:08.243 7fb08bf2ecc8 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 05/15/2025 02:00:08.244 7fb08424a438 [contrail-analytics-api] [ERROR]: Cannot write http_port 8090 to /tmp/contrail-analytics-api.0.http_port 05/15/2025 02:00:08.245 7fb08424a438 [contrail-analytics-api] [ERROR]: Starting Introspect on HTTP Port 8090 05/15/2025 02:00:08.245 7fb084256d68 [contrail-analytics-api] [INFO]: Processing event[EvStart] in state[none] 05/15/2025 02:00:08.245 7fb084256d68 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 05/15/2025 02:00:08.245 7fb084256d68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 05/15/2025 02:00:08.246 7fb084256d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/15/2025 02:00:08.246 7fb084256d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3313-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, ] description = >>, ] >> 05/15/2025 02:00:08.246 7fb084256d68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/15/2025 02:00:08.246 7fb084256d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/15/2025 02:00:08.246 7fb084256d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3313-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Initializing description = Redis Instance initialized >>, ] description = Redis-UVE:10.0.0.50:6379[Redis Instance initialized] connection down >>, ] >> 05/15/2025 02:00:08.246 7fb084256d68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/15/2025 02:00:08.247 7fb084256d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/15/2025 02:00:08.247 7fb084256d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3313-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.50:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, ] description = Redis-UVE:10.0.0.50:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized] connection down >>, ] >> 05/15/2025 02:00:08.247 7fb084256d68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/15/2025 02:00:08.247 7fb084256d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/15/2025 02:00:08.247 7fb084256d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] AnalyticsApiInfoUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3313-1. analytics_node_ip = { rest_api_ip : 10.0.0.50host_ip : 10.0.0.50 } >> 05/15/2025 02:00:08.247 7fb084256d68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/15/2025 02:00:08.247 7fb084256d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/15/2025 02:00:08.247 7fb084256d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3313-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.50:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Redis-UVE:10.0.0.50:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 05/15/2025 02:00:08.247 7fb084256d68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/15/2025 02:00:08.248 7fb084256d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/15/2025 02:00:08.248 7fb084256d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3313-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1747274408245716 collector_name = collector_ip = collector_list = [ 10.0.0.50:8086, ] >> sm_queue_count = 5 max_sm_queue_count = 5 >> 05/15/2025 02:00:08.248 7fb084256d68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/15/2025 02:00:08.248 7fb089ae1c18 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 05/15/2025 02:00:08.257 7fb08866feb8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/15/2025 02:00:08.257 7fb08866feb8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3313-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.50:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Initializing description = Connection to API Server initialized >>, ] description = Redis-UVE:10.0.0.50:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[Connection to API Server initialized] connection down >>, ] >> 05/15/2025 02:00:08.259 7fb08866feb8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/15/2025 02:00:08.263 7fb0885d4240 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/15/2025 02:00:08.263 7fb0885d4240 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3313-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.50:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Initializing description = Connection to API Server initialized >>, ] description = Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[Connection to API Server initialized] connection down >>, ] >> 05/15/2025 02:00:08.263 7fb0885d4240 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/15/2025 02:00:08.267 7fb08bd334e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/15/2025 02:00:08.268 7fb08bd334e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3313-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.50:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = Connection to API Server established >>, ] description = Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 05/15/2025 02:00:08.268 7fb08bd334e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/15/2025 02:00:08.268 7fb0886388d0 [contrail-analytics-api] [INFO]: Analytics Discovery listen CONNECTED 05/15/2025 02:00:08.268 7fb0886388d0 [contrail-analytics-api] [INFO]: Analytics Discovery to publish None 05/15/2025 02:00:08.268 7fb08bf60eb8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/15/2025 02:00:08.269 7fb08bf60eb8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3313-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.50:2181, ] status = Up description = Connection to Zookeeper re-established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 05/15/2025 02:00:08.270 7fb08bf60eb8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/15/2025 02:00:08.270 7fb08bf60eb8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/15/2025 02:00:08.270 7fb08bf60eb8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3313-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.50:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 05/15/2025 02:00:08.270 7fb08bf60eb8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/15/2025 02:00:08.275 7fb089ae1c18 [contrail-analytics-api] [INFO]: Analytics Discovery Watcher AlarmGenerator Children [] 05/15/2025 02:00:08.277 7fb089ae1c18 [contrail-analytics-api] [INFO]: Analytics Discovery OpServer reconnect 05/15/2025 02:00:08.278 7fb089ae1c18 [contrail-analytics-api] [INFO]: ensure /analytics-discovery-/OpServer 05/15/2025 02:00:08.278 7fb089ae1c18 [contrail-analytics-api] [INFO]: zk state CONNECTED (CONNECTED) 05/15/2025 02:00:08.281 7fb089ae1c18 [contrail-analytics-api] [INFO]: check for /analytics-discovery-/OpServer/cn-jenkins-deploy-platform-ansible-os-3313-1.-0 05/15/2025 02:00:12.249 7fb0886038d0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/15/2025 02:00:12.250 7fb0886038d0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 05/15/2025 02:00:12.250 7fb0886038d0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/15/2025 02:00:12.250 7fb0886038d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/15/2025 02:00:12.250 7fb0886038d0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3313-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.50:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.50:6379 server_addrs = [ 10.0.0.50:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.50:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/15/2025 02:00:12.250 7fb0886038d0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/15/2025 02:00:12.250 7fb0886038d0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 05/15/2025 02:00:12.250 7fb0886038d0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 05/15/2025 02:00:12.251 7fb0886038d0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 05/15/2025 02:00:12.251 7fb0886038d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 05/15/2025 02:00:12.251 7fb0886038d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 05/15/2025 02:00:12.251 7fb088603390 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 05/15/2025 02:00:12.252 7fb088603390 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 05/15/2025 02:00:12.254 7fb084256ac8 [contrail-analytics-api] [DEBUG]: Extracted sandesh length: 0000001017 05/15/2025 02:00:12.255 7fb084256ac8 [contrail-analytics-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 05/15/2025 02:00:12.255 7fb0836ab8d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 05/15/2025 02:00:12.255 7fb0836ab8d0 [contrail-analytics-api] [DEBUG]: Number of uve types in sandesh control message is 0 05/15/2025 02:00:12.255 7fb0836ab8d0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 05/15/2025 02:00:12.255 7fb0836ab8d0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 05/15/2025 02:00:12.255 7fb0836ab8d0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 05/15/2025 02:00:12.255 7fb0836ab8d0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 05/15/2025 02:00:12.256 7fb088603390 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 05/15/2025 02:00:12.257 7fb088603390 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 05/15/2025 02:00:13.496 7fb0836ab8d0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoJUqtgMOqYBwZFZAAOqgX6ezS4B4PDmL_z80PGkkLHwAQvOTzFhFj-HLyeazHM_fZW_AASH6R3gSCoqMgjhy0eom60OKPqjRt5_RSD4MOWtXXUmGLlN_Afw2G9bN9qErkMw1m0c7nE72nX3FNRNsMmwJmUwEAcTFx1VrNyqHGYuGG6Sc 05/15/2025 02:00:13.496 7fb0836ab8d0 [contrail-analytics-api] [DEBUG]: user resources are None 05/15/2025 02:00:13.498 7fb08a070390 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.50 object_type = vrouter request_url = http://10.0.0.50:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 1238 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3313-1. >> 05/15/2025 02:00:13.894 7fb0836ab8d0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoJUqtyG8rgfz4iz7IJdZ_0lj-mXYhyu11kSwBpfnJKTRw3SnPmB86DLJetyQtHwxZLpq_vbCRFVy7Te394Cibqpf_sP4UlKy9EuqHoTFEXqE0KRR9Li0nvI-ctY3VSWzC2yAwyaMiPQIJ1ZNLelefy23Nt0ik7kNki0OuywCCditW5yU 05/15/2025 02:00:13.895 7fb0836ab8d0 [contrail-analytics-api] [DEBUG]: user resources are None 05/15/2025 02:00:13.895 7fb08bd33390 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.50 object_type = vrouter request_url = http://10.0.0.50:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 763 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3313-1. >> 05/15/2025 02:00:19.571 7fb084256ac8 [contrail-analytics-api] [DEBUG]: Extracted sandesh length: 0000001436 05/15/2025 02:00:19.572 7fb084256ac8 [contrail-analytics-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 05/15/2025 02:00:19.572 7fb0823d8d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 05/15/2025 02:00:19.572 7fb0823d8d68 [contrail-analytics-api] [DEBUG]: Number of uve types in sandesh control message is 3 05/15/2025 02:00:19.572 7fb0823d8d68 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 05/15/2025 02:00:19.573 7fb0823d8d68 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 05/15/2025 02:00:19.573 7fb0823d8d68 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 05/15/2025 02:00:19.573 7fb08bd33390 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 05/15/2025 02:00:19.573 7fb08bd33390 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 05/15/2025 02:00:23.215 7fb088638780 [contrail-analytics-api] [INFO]: Analytics Discovery Watcher AlarmGenerator Children ['cn-jenkins-deploy-platform-ansible-os-3313-1.-0'] 05/15/2025 02:00:28.286 7fb089ae1c18 [contrail-analytics-api] [INFO]: Analytics Discovery OpServer reconnect 05/15/2025 02:00:28.286 7fb089ae1c18 [contrail-analytics-api] [INFO]: ensure /analytics-discovery-/OpServer 05/15/2025 02:00:28.286 7fb089ae1c18 [contrail-analytics-api] [INFO]: zk state CONNECTED (CONNECTED) 05/15/2025 02:00:28.288 7fb089ae1c18 [contrail-analytics-api] [INFO]: check for /analytics-discovery-/OpServer/cn-jenkins-deploy-platform-ansible-os-3313-1.-0 05/15/2025 02:00:28.292 7fb089ae1c18 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-3313-1.-0, data b'{"ip-address": "10.0.0.50", "instance-id": "0", "redis-ip": "10.0.0.50", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{}"}', event None 05/15/2025 02:00:28.293 7fb089ae1c18 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-3313-1.-0, data OrderedDict([('instance-id', '0'), ('ip-address', '10.0.0.50'), ('partitions', '{}'), ('redis-agg-db', 7), ('redis-ip', '10.0.0.50'), ('redis-port', '6379')]), event GET 05/15/2025 02:00:32.447 7fb088638780 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-3313-1.-0, data b'{"ip-address": "10.0.0.50", "instance-id": "0", "redis-ip": "10.0.0.50", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{}"}', event WatchedEvent(type='CHANGED', state='CONNECTED', path='/analytics-discovery-/AlarmGenerator/cn-jenkins-deploy-platform-ansible-os-3313-1.-0') 05/15/2025 02:00:33.434 7fb088638780 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-3313-1.-0, data b'{"ip-address": "10.0.0.50", "instance-id": "0", "redis-ip": "10.0.0.50", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{\\"0\\": 1747274432718446, \\"1\\": 1747274432723741, \\"2\\": 1747274432728044, \\"3\\": 1747274432749679, \\"4\\": 1747274432780755, \\"5\\": 1747274432794303, \\"6\\": 1747274432803125, \\"7\\": 1747274432831457, \\"8\\": 1747274432855350, \\"9\\": 1747274432866393, \\"10\\": 1747274432883463, \\"11\\": 1747274432925255, \\"12\\": 1747274432935458, \\"13\\": 1747274432957417, \\"14\\": 1747274432974443, \\"15\\": 1747274432986772, \\"16\\": 1747274433016181, \\"17\\": 1747274433043468, \\"18\\": 1747274433056551, \\"19\\": 1747274433079557, \\"20\\": 1747274433120057, \\"21\\": 1747274433144091, \\"22\\": 1747274433158387, \\"23\\": 1747274433181878, \\"24\\": 1747274433205079, \\"25\\": 1747274433224041, \\"26\\": 1747274433264102, \\"27\\": 1747274433287638, \\"28\\": 1747274433300113, \\"29\\": 1747274433371878}"}', event WatchedEvent(type='CHANGED', state='CONNECTED', path='/analytics-discovery-/AlarmGenerator/cn-jenkins-deploy-platform-ansible-os-3313-1.-0') 05/15/2025 02:01:14.278 7fb088603240 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoJUrqkQjnCHj3wG6OD7miq-lieqF31VLNfpQAfgqwAFcjuZXX__Xmgt9bNmurGO-H-u2b0360_TVMe7LGkp8H73-cgJAj7XeuE8v8Y80tQowCR-tOXFyuKUUTY_2Tg-y-6WxJIswnZQV5JncjT8klCI0YCF7tRlvOMXN10m1Wz1Zdz2g 05/15/2025 02:01:14.278 7fb088603240 [contrail-analytics-api] [DEBUG]: user resources are None 05/15/2025 02:01:14.279 7fb088601978 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.50 object_type = vrouter request_url = http://10.0.0.50:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 786 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3313-1. >> 05/15/2025 02:01:14.660 7fb088603240 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoJUrqPgLnIgBqeQSsSmr3OC46SvyrCcPMgicLWlKQP7rNA9IQ2mN5bODm1L2n6j18pkBuzkaOvqV_BEaeB8NOqXG8EFxWLdXZZJL46C9XlT3C0fxuyREJQ3CjG19qgiJ-znPiAmgFQQVa-cIlsczCQM0eui0fQ7AqigFLGVSuLpKqlrk 05/15/2025 02:01:14.660 7fb088603240 [contrail-analytics-api] [DEBUG]: user resources are None 05/15/2025 02:01:14.661 7fb08bab2eb8 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.50 object_type = vrouter request_url = http://10.0.0.50:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 856 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3313-1. >> 05/15/2025 02:02:15.054 7fb088603240 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoJUsmw3HaGXEDWe8CcGGlsShcyjmPuIpgoVqOkFqHv8UUKQnMareLZdOn_49zMYhuFxqO3C-bzU-fK8Tqoay26l3G3PJIAY0c02fnOqTorzwemc8jEfLsDQw8S-g8a4RIReo31sddHkMX-4o83HjDfbcXvyR-vdrRY4pReC6XBS3VGsw 05/15/2025 02:02:15.054 7fb088603240 [contrail-analytics-api] [DEBUG]: user resources are None 05/15/2025 02:02:15.055 7fb088601ac8 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.50 object_type = vrouter request_url = http://10.0.0.50:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 875 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3313-1. >> 05/15/2025 02:02:15.434 7fb088603240 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoJUsn7CG3Noy1MZl3ZwST2ji1fW0T9AsCFK6rdP09FBSvZcvjudK5VGxh3jP6FiEzIR_VABM1vv8v-PZ_gOuTgaZxjGy5qux7oglxzFCT-RitmLh7sBrXtotEdbA1ggPRuhU3TpK1ybpUwqm0Ma8aqpML3RQYb-GeIH6XGQ2-mOYpXV4 05/15/2025 02:02:15.434 7fb088603240 [contrail-analytics-api] [DEBUG]: user resources are None 05/15/2025 02:02:15.435 7fb08a184eb8 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.50 object_type = vrouter request_url = http://10.0.0.50:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 820 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3313-1. >> 05/15/2025 02:02:54.088 7fb088603240 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 05/15/2025 02:02:56.208 7fb087060048 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 05/15/2025 02:03:15.830 7fb087060048 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoJUtjFW2pX8XvtQJcL2HYtZ7egpY1oaLv5Ptfbb0l0szf4weiHRu_AKBVmeF7MVNOOFUCRPql3dHaBGASLqMQFFmZQYGRQS1hNa8bVxIkGyJPYc9RPZqv1nXXSO567giTZenQI0gvCrhP05ARbTusUsjfCTtDeW0MRl0JKmqPDybdx4w 05/15/2025 02:03:15.830 7fb087060048 [contrail-analytics-api] [DEBUG]: user resources are None 05/15/2025 02:03:15.832 7fb087060048 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3313-1 as ['VrouterAgent'] 05/15/2025 02:03:15.833 7fb089ae1390 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.50 object_type = vrouter request_url = http://10.0.0.50:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 3162 response_size_objects = 1 response_size_bytes = 104 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3313-1. >> 05/15/2025 02:03:16.214 7fb087060048 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoJUtkEVyeaItYcM_ULlC38HxXKLBFHX33sNOuLaF4qfKIHWTKdw2YiP6e9KMAySItbW5mIYRxsw94qaRdVEEEK2B_K5DEvVJNTNktpdEDKLOVMHrlwrkuKMNVpd83Ur-ptQNZm3n0ajqF5qNicIJaATFxWJirP52coAgJaoreqRDBahM 05/15/2025 02:03:16.214 7fb087060048 [contrail-analytics-api] [DEBUG]: user resources are None 05/15/2025 02:03:16.216 7fb087060048 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3313-1 as ['NodeStatus'] 05/15/2025 02:03:16.217 7fb0886000f0 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.50 object_type = vrouter request_url = http://10.0.0.50:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 2429 response_size_objects = 1 response_size_bytes = 930 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3313-1. >> 05/15/2025 02:03:26.893 7fb087060048 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 05/15/2025 02:03:27.285 7fb087060048 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 05/15/2025 02:04:16.699 7fb087060048 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoJUugSiGl4Vr3xZhCc2VLJjzgYMuQKy98N6jcY0pbw1wtUj31WYIJvg1JM3ds1MJhVBWSaZOlxd_vdMHMuAunaFHXea3OOpXVUGMedeb3MFGtMZmAXwVa2WulcLfcSTxwVpLIBAUBJO-PQh-SFiOAKtMx-Y-3u2wdnqtHj9RGr8sTs58 05/15/2025 02:04:16.699 7fb087060048 [contrail-analytics-api] [DEBUG]: user resources are None 05/15/2025 02:04:16.701 7fb087060048 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3313-1 as ['VrouterAgent'] 05/15/2025 02:04:16.702 7fb088601198 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.50 object_type = vrouter request_url = http://10.0.0.50:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 2520 response_size_objects = 1 response_size_bytes = 104 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3313-1. >> 05/15/2025 02:04:17.121 7fb087060048 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoJUuhwLe5Cn6SejyeMyhUO-VGStFBQO0b5-MYTugyH9jIbJJHoo3A7KfCf7FEszwBZs0V0FZ09gT67x7Zu9mwUpMKALE2_JXtGUgykUXeCJxkfo3DE94V2rGs_dthjnpBz7_o85BqfCNghw4JPd-7pUGocB4vR8QYc86UnkS_u2Ny_qg 05/15/2025 02:04:17.121 7fb087060048 [contrail-analytics-api] [DEBUG]: user resources are None 05/15/2025 02:04:17.124 7fb087060048 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3313-1 as ['NodeStatus'] 05/15/2025 02:04:17.124 7fb089aea0f0 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.50 object_type = vrouter request_url = http://10.0.0.50:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 3160 response_size_objects = 1 response_size_bytes = 930 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3313-1. >> 05/15/2025 02:05:17.553 7fb0886038d0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoJUvdZHr9v2iAg4DRRgQvo3r6VgGVJShwAmVl2LJnOzI7rxSA-8m9L-M7fzm1e6yTFtfA6K3zoPxX5xpeHP22PHX6quK554RPJnv3PN6bqVmnVQFBhxa7qiXskwWcTgchkU4eXhpuGE21tcGuhFOX1v6t49CaKK9W72yFYpTfDZj14UY 05/15/2025 02:05:17.553 7fb0886038d0 [contrail-analytics-api] [DEBUG]: user resources are None 05/15/2025 02:05:17.555 7fb0886038d0 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3313-1 as ['VrouterAgent'] 05/15/2025 02:05:17.556 7fb088603ac8 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.50 object_type = vrouter request_url = http://10.0.0.50:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 2271 response_size_objects = 1 response_size_bytes = 104 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3313-1. >> 05/15/2025 02:05:17.958 7fb0886038d0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoJUvdDlfETO4YV8ADL-WPrOmlcY49nQpNwFG60ugihpeiFnOAc6q8cMqPkMu9QO3dXG8JQBeVHcrcaJJhr2r3LdF5XoKWEWxeQU1S9D4USQ10dnd7gj-6gk5qifjrLGikIIb3E1W9kR-RUcphuWzga3tM6FWGzhKcqjcEsJsa7DFw_wY 05/15/2025 02:05:17.958 7fb0886038d0 [contrail-analytics-api] [DEBUG]: user resources are None 05/15/2025 02:05:17.960 7fb0886038d0 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3313-1 as ['NodeStatus'] 05/15/2025 02:05:17.961 7fb088638d68 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.50 object_type = vrouter request_url = http://10.0.0.50:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 2572 response_size_objects = 1 response_size_bytes = 930 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3313-1. >> 05/15/2025 02:06:20.552 7fb0886038d0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoJUwc8P2CwEI_A9xRxcpHJc2KzfyfP0Y9uL2cbbgCX46UAin7dXxzVnxrG0KWkvthDzkjV257z_Uj1cXh8Nw_Js6fXn-8WkrLjiq_gVTfikhIh1HyM_-pR73BCeEOhcdnFgcdnZU05gH0DZrRMEqscoOX7mv5tmzUzOTvXJfH7bYG4HI 05/15/2025 02:06:20.553 7fb0886038d0 [contrail-analytics-api] [DEBUG]: user resources are None 05/15/2025 02:06:20.555 7fb0886038d0 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3313-1 as ['VrouterAgent'] 05/15/2025 02:06:20.556 7fb088633978 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.50 object_type = vrouter request_url = http://10.0.0.50:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 3223 response_size_objects = 1 response_size_bytes = 104 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3313-1. >> 05/15/2025 02:06:20.944 7fb088633978 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoJUwcJGx1Um9jra022H97yR5xIRnvrYQKt4QF-Enr3qBLP4-Rro0warks2stIs-pDzSeCOP7vwAAWafMZp0kO4v5g43G89e6Iz-ninl6Lk8L8VDbTxNTh2TMWKJe1N2OPXezQVAhtBLOpZE3aJg6v9bWrx3_Gn-uk86ycKcBSPiThph8 05/15/2025 02:06:20.944 7fb088633978 [contrail-analytics-api] [DEBUG]: user resources are None 05/15/2025 02:06:20.946 7fb088633978 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3313-1 as ['NodeStatus'] 05/15/2025 02:06:20.947 7fb088600a20 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.50 object_type = vrouter request_url = http://10.0.0.50:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 2542 response_size_objects = 1 response_size_bytes = 930 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3313-1. >> 05/15/2025 02:06:32.400 7fb088633978 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map