03/20/2025 02:21:14.081 7fbff7b82848 [contrail-analytics-api] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 03/20/2025 02:21:14.082 7fbff7b82848 [contrail-analytics-api] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 03/20/2025 02:21:14.082 7fbff7b82848 [contrail-analytics-api] [INFO]: SANDESH: Flow Logging: [None] -> [False] 03/20/2025 02:21:14.082 7fbff7b82848 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:NodeStatusUVE] map 03/20/2025 02:21:14.113 7fbff7b82848 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 03/20/2025 02:21:14.115 7fbff1381d68 [contrail-analytics-api] [ERROR]: Cannot write http_port 8090 to /tmp/contrail-analytics-api.0.http_port 03/20/2025 02:21:14.115 7fbff1381d68 [contrail-analytics-api] [ERROR]: Starting Introspect on HTTP Port 8090 03/20/2025 02:21:14.115 7fbff13486d8 [contrail-analytics-api] [INFO]: Processing event[EvStart] in state[none] 03/20/2025 02:21:14.116 7fbff13486d8 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 02:21:14.117 7fbff13486d8 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 03/20/2025 02:21:14.118 7fbff13486d8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:21:14.118 7fbff13486d8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2925-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.24:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, ] description = >>, ] >> 03/20/2025 02:21:14.119 7fbff13486d8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:21:14.119 7fbff13486d8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:21:14.119 7fbff13486d8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2925-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.24:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.24:6379 server_addrs = [ 10.0.0.24:6379, ] status = Initializing description = Redis Instance initialized >>, ] description = Redis-UVE:10.0.0.24:6379[Redis Instance initialized] connection down >>, ] >> 03/20/2025 02:21:14.119 7fbff13486d8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:21:14.119 7fbff13486d8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:21:14.119 7fbff13486d8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2925-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.24:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.24:6379 server_addrs = [ 10.0.0.24:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.24:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, ] description = Redis-UVE:10.0.0.24:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized] connection down >>, ] >> 03/20/2025 02:21:14.119 7fbff13486d8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:21:14.119 7fbff13486d8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:21:14.119 7fbff13486d8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] AnalyticsApiInfoUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2925-1. analytics_node_ip = { rest_api_ip : 10.0.0.24host_ip : 10.0.0.24 } >> 03/20/2025 02:21:14.119 7fbff13486d8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:21:14.119 7fbff13486d8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:21:14.119 7fbff13486d8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2925-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.24:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.24:6379 server_addrs = [ 10.0.0.24:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.24:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Redis-UVE:10.0.0.24:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 02:21:14.119 7fbff13486d8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:21:14.120 7fbff13486d8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:21:14.120 7fbff13486d8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2925-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1742437274116583 collector_name = collector_ip = collector_list = [ 10.0.0.24:8086, ] >> sm_queue_count = 5 max_sm_queue_count = 5 >> 03/20/2025 02:21:14.120 7fbff13486d8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:21:14.121 7fbff552f198 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 03/20/2025 02:21:14.132 7fbff58394e0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:21:14.132 7fbff58394e0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2925-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.24:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.24:6379 server_addrs = [ 10.0.0.24:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.24:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.24:8082, ] status = Initializing description = Connection to API Server initialized >>, ] description = Redis-UVE:10.0.0.24:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[Connection to API Server initialized] connection down >>, ] >> 03/20/2025 02:21:14.133 7fbff58394e0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:21:14.141 7fbff4368a20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:21:14.142 7fbff4368a20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2925-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.24:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.24:6379 server_addrs = [ 10.0.0.24:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.24:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.24:8082, ] status = Initializing description = Connection to API Server initialized >>, ] description = Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[Connection to API Server initialized] connection down >>, ] >> 03/20/2025 02:21:14.142 7fbff4368a20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:21:14.148 7fbff75b8b70 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:21:14.149 7fbff75b8b70 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2925-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.24:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.24:6379 server_addrs = [ 10.0.0.24:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.24:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.24:8082, ] status = Up description = Connection to API Server established >>, ] description = Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 02:21:14.149 7fbff75b8b70 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:21:14.149 7fbff4368390 [contrail-analytics-api] [INFO]: Analytics Discovery listen CONNECTED 03/20/2025 02:21:14.150 7fbff4368390 [contrail-analytics-api] [INFO]: Analytics Discovery to publish None 03/20/2025 02:21:14.150 7fbff7b7a2e8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:21:14.151 7fbff7b7a2e8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2925-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.24:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.24:6379 server_addrs = [ 10.0.0.24:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.24:2181, ] status = Up description = Connection to Zookeeper re-established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.24:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 02:21:14.151 7fbff7b7a2e8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:21:14.151 7fbff7b7a2e8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:21:14.151 7fbff7b7a2e8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2925-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.24:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.24:6379 server_addrs = [ 10.0.0.24:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.24:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.24:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 02:21:14.151 7fbff7b7a2e8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:21:14.157 7fbff552f198 [contrail-analytics-api] [INFO]: Analytics Discovery Watcher AlarmGenerator Children [] 03/20/2025 02:21:14.160 7fbff552f198 [contrail-analytics-api] [INFO]: Analytics Discovery OpServer reconnect 03/20/2025 02:21:14.160 7fbff552f198 [contrail-analytics-api] [INFO]: ensure /analytics-discovery-/OpServer 03/20/2025 02:21:14.160 7fbff552f198 [contrail-analytics-api] [INFO]: zk state CONNECTED (CONNECTED) 03/20/2025 02:21:14.168 7fbff552f198 [contrail-analytics-api] [INFO]: check for /analytics-discovery-/OpServer/cn-jenkins-deploy-platform-ansible-os-2925-1.-0 03/20/2025 02:21:18.121 7fbff583c0f0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 02:21:18.122 7fbff583c0f0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 03/20/2025 02:21:18.122 7fbff583c0f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 02:21:18.122 7fbff583c0f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 02:21:18.122 7fbff583c0f0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2925-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.24:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.24:6379 server_addrs = [ 10.0.0.24:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.24:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.24:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.24:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 02:21:18.122 7fbff583c0f0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 02:21:18.122 7fbff583c0f0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/20/2025 02:21:18.123 7fbff583c0f0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 03/20/2025 02:21:18.123 7fbff583c0f0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/20/2025 02:21:18.123 7fbff583c0f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 02:21:18.123 7fbff583c0f0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 02:21:18.123 7fbff432f048 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 02:21:18.124 7fbff432f048 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 02:21:18.127 7fbff432fac8 [contrail-analytics-api] [DEBUG]: Extracted sandesh length: 0000001017 03/20/2025 02:21:18.128 7fbff432fac8 [contrail-analytics-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/20/2025 02:21:18.128 7fbff432fe10 [contrail-analytics-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 03/20/2025 02:21:18.128 7fbff432fe10 [contrail-analytics-api] [DEBUG]: Number of uve types in sandesh control message is 0 03/20/2025 02:21:18.129 7fbff432fe10 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 03/20/2025 02:21:18.129 7fbff432fe10 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 03/20/2025 02:21:18.129 7fbff432fe10 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 02:21:18.129 7fbff432fe10 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 03/20/2025 02:21:18.129 7fbff432ff60 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 02:21:18.130 7fbff432ff60 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 02:21:27.750 7fbff583c0f0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABn23unDN2Rgj8seDPhLvL9iohZknArlSNtRuZ1lS_x5KVvZ-CPpvg3-BhqIYQB6rpk2twYti7Tm8A9JNfta-Jax6zVButY1Csgu0kVAIObhF_IIVJms485z6J19XfcwC9r0SAYeUkV3iPitQWlqGr2sypGR-0zm83LKLTlgAhVIWDleNo 03/20/2025 02:21:27.751 7fbff583c0f0 [contrail-analytics-api] [DEBUG]: user resources are None 03/20/2025 02:21:27.752 7fbff432fa20 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.24 object_type = vrouter request_url = http://10.0.0.24:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 1379 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-2925-1. >> 03/20/2025 02:21:28.469 7fbff583c0f0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABn23uoEWa1kp2s-HquwxrhirYdDzXnwCa-sJUhIJkUu09hD4b1kGJs10y1K5rgCkJBWup7Cu_HChZQ28L66kTw_-z-q7EZKP4i7Lgv1qD_qPL3rK_OvSu7SZvlaoR0XHOLvsFMjLCW0UwdaZu1Vo7beR59sSFxPbJ1EEyCLbPXqCpX5JM 03/20/2025 02:21:28.469 7fbff583c0f0 [contrail-analytics-api] [DEBUG]: user resources are None 03/20/2025 02:21:28.470 7fbff5d97e10 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.24 object_type = vrouter request_url = http://10.0.0.24:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 833 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-2925-1. >> 03/20/2025 02:21:31.509 7fbff432fac8 [contrail-analytics-api] [DEBUG]: Extracted sandesh length: 0000001436 03/20/2025 02:21:31.510 7fbff432fac8 [contrail-analytics-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/20/2025 02:21:31.510 7fbff75b8b70 [contrail-analytics-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 03/20/2025 02:21:31.510 7fbff75b8b70 [contrail-analytics-api] [DEBUG]: Number of uve types in sandesh control message is 3 03/20/2025 02:21:31.510 7fbff75b8b70 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 03/20/2025 02:21:31.510 7fbff75b8b70 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 03/20/2025 02:21:31.510 7fbff75b8b70 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 02:21:31.511 7fbff5d97e10 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 02:21:31.511 7fbff5d97e10 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 02:21:35.149 7fbff4368198 [contrail-analytics-api] [INFO]: Analytics Discovery Watcher AlarmGenerator Children ['cn-jenkins-deploy-platform-ansible-os-2925-1.-0'] 03/20/2025 02:21:44.174 7fbff552f198 [contrail-analytics-api] [INFO]: Analytics Discovery OpServer reconnect 03/20/2025 02:21:44.174 7fbff552f198 [contrail-analytics-api] [INFO]: ensure /analytics-discovery-/OpServer 03/20/2025 02:21:44.174 7fbff552f198 [contrail-analytics-api] [INFO]: zk state CONNECTED (CONNECTED) 03/20/2025 02:21:44.176 7fbff552f198 [contrail-analytics-api] [INFO]: check for /analytics-discovery-/OpServer/cn-jenkins-deploy-platform-ansible-os-2925-1.-0 03/20/2025 02:21:44.179 7fbff552f198 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-2925-1.-0, data b'{"ip-address": "10.0.0.24", "instance-id": "0", "redis-ip": "10.0.0.24", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{}"}', event None 03/20/2025 02:21:44.180 7fbff552f198 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-2925-1.-0, data OrderedDict([('instance-id', '0'), ('ip-address', '10.0.0.24'), ('partitions', '{}'), ('redis-agg-db', 7), ('redis-ip', '10.0.0.24'), ('redis-port', '6379')]), event GET 03/20/2025 02:21:44.266 7fbff4368198 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-2925-1.-0, data b'{"ip-address": "10.0.0.24", "instance-id": "0", "redis-ip": "10.0.0.24", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{}"}', event WatchedEvent(type='CHANGED', state='CONNECTED', path='/analytics-discovery-/AlarmGenerator/cn-jenkins-deploy-platform-ansible-os-2925-1.-0') 03/20/2025 02:21:45.846 7fbff4368198 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-2925-1.-0, data b'{"ip-address": "10.0.0.24", "instance-id": "0", "redis-ip": "10.0.0.24", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{\\"1\\": 1742437304480065, \\"5\\": 1742437304489785, \\"4\\": 1742437304490329, \\"2\\": 1742437304490499, \\"0\\": 1742437304490649, \\"7\\": 1742437304506800, \\"6\\": 1742437304506981, \\"3\\": 1742437304507126, \\"17\\": 1742437304519924, \\"14\\": 1742437304520498, \\"12\\": 1742437304520750, \\"11\\": 1742437304520917, \\"10\\": 1742437304521059, \\"9\\": 1742437304521197, \\"8\\": 1742437304521351, \\"21\\": 1742437304586849, \\"19\\": 1742437304587214, \\"18\\": 1742437304587395, \\"16\\": 1742437304587541, \\"15\\": 1742437304587685, \\"25\\": 1742437304800230, \\"24\\": 1742437304800566, \\"23\\": 1742437304800887, \\"22\\": 1742437304801177, \\"20\\": 1742437304801461, \\"28\\": 1742437304945769, \\"27\\": 1742437304945963, \\"26\\": 1742437304946115, \\"29\\": 1742437305074411}"}', event WatchedEvent(type='CHANGED', state='CONNECTED', path='/analytics-discovery-/AlarmGenerator/cn-jenkins-deploy-platform-ansible-os-2925-1.-0') 03/20/2025 02:21:46.178 7fbff4368198 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-2925-1.-0, data b'{"ip-address": "10.0.0.24", "instance-id": "0", "redis-ip": "10.0.0.24", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{\\"1\\": 1742437304480065, \\"5\\": 1742437304489785, \\"4\\": 1742437304490329, \\"2\\": 1742437304490499, \\"0\\": 1742437304490649, \\"7\\": 1742437304506800, \\"6\\": 1742437304506981, \\"3\\": 1742437304507126, \\"17\\": 1742437304519924, \\"14\\": 1742437304520498, \\"12\\": 1742437304520750, \\"11\\": 1742437304520917, \\"10\\": 1742437304521059, \\"9\\": 1742437304521197, \\"8\\": 1742437304521351, \\"21\\": 1742437304586849, \\"19\\": 1742437304587214, \\"18\\": 1742437304587395, \\"16\\": 1742437304587541, \\"15\\": 1742437304587685, \\"25\\": 1742437304800230, \\"24\\": 1742437304800566, \\"23\\": 1742437304800887, \\"22\\": 1742437304801177, \\"20\\": 1742437304801461, \\"28\\": 1742437304945769, \\"27\\": 1742437304945963, \\"26\\": 1742437304946115, \\"29\\": 1742437305074411, \\"13\\": 1742437305360731}"}', event WatchedEvent(type='CHANGED', state='CONNECTED', path='/analytics-discovery-/AlarmGenerator/cn-jenkins-deploy-platform-ansible-os-2925-1.-0') 03/20/2025 02:22:28.895 7fbff432c828 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABn23vkf5Ue3oErKW5G268ycWu_G5_as--x2PnMQeH0xTEyC46jzPQUoEAM9FWv0PG6cf1ig1O5vv6jz1_kPwySmWM6-Ea9qks2x1aReiNwRKSYPItG0k1WWPmmlmfMSA1Z4oHYIEANpeAGgWOhAaa-VY6ikw55la09p1te9bg4UxBpTCo 03/20/2025 02:22:28.896 7fbff432c828 [contrail-analytics-api] [DEBUG]: user resources are None 03/20/2025 02:22:28.897 7fbff432f2e8 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.24 object_type = vrouter request_url = http://10.0.0.24:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 1012 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-2925-1. >> 03/20/2025 02:22:29.312 7fbff432c828 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABn23vl6yL0k7G3JhvDTZH8G7_kjOC-bTnfyVrH0ZfhLxfw-lLWu3Pk0oj3SWJWLO2ClsVbkbutigi3rbdzZGt5xKp6Mchg6lNjbtmxxOd_ep4IKu0B-F5qeUbKRm4SpvlsrhgvN8527V-7fD6QsBViZhnlDnYrpjHfICauPpLhoylt0SM 03/20/2025 02:22:29.312 7fbff432c828 [contrail-analytics-api] [DEBUG]: user resources are None 03/20/2025 02:22:29.314 7fbff432cac8 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.24 object_type = vrouter request_url = http://10.0.0.24:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 1243 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-2925-1. >> 03/20/2025 02:23:05.104 7fbff432c828 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 03/20/2025 02:23:06.839 7fbff432c828 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 03/20/2025 02:23:29.827 7fbff432c828 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABn23wh5b3_jVezDnFnIh_91MJsjB5YiM-k41M9oH95wJec4R_YL-wUFIXpsH282Gd1RuBaWXJMJZjC3ihnDwj4r_V0c4fzNiCpABrG2phC-hIk9V9IynvWT9yZWqo7oMPxdBprForrr_U9vKoEXX--g2-6jOS7BUlmY323Db3rl__ZuII 03/20/2025 02:23:29.827 7fbff432c828 [contrail-analytics-api] [DEBUG]: user resources are None 03/20/2025 02:23:29.829 7fbff4368978 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.24 object_type = vrouter request_url = http://10.0.0.24:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 956 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-2925-1. >> 03/20/2025 02:23:30.222 7fbff432c828 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABn23wi9rMWHO25m7OfCd3WNwsPOV9rQmhVEfe3bPoPKY1uLrbEWWbDD6I2q0ka3XQ8VJMbFKyxUaoBCBeH8zMBIs1Hz5SEZtz8X7CyfKSztoMGbbQle8eZ9rSRJlf9D9O3t_g5RGrBeTnAFRJ7-7OODCf39sLxbMKpYrGLEEVHCE99YWE 03/20/2025 02:23:30.222 7fbff432c828 [contrail-analytics-api] [DEBUG]: user resources are None 03/20/2025 02:23:30.225 7fbff432c828 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-2925-1 as ['NodeStatus'] 03/20/2025 02:23:30.226 7fbff432b438 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.24 object_type = vrouter request_url = http://10.0.0.24:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 3175 response_size_objects = 1 response_size_bytes = 652 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-2925-1. >> 03/20/2025 02:23:39.160 7fbff432c828 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 03/20/2025 02:23:41.478 7fbfeec4f588 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 03/20/2025 02:24:30.613 7fbfeec4f588 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABn23xeJtyIWhbFb2JXZ0t53SZN1px0RqgiGCXuQa4sdM6jbHMy7ngVzbw1w2qp7c1uPPmXiLlY4YrFApBuLig3Ra0-kg9sNnWwZ1lzVNAbNNq7N1FPl73o99DLg-RFB9YkmYF9rGnsKK9FK8s3cCutyx2iz7INqbWW0IUkuh-NCRCH1V8 03/20/2025 02:24:30.613 7fbfeec4f588 [contrail-analytics-api] [DEBUG]: user resources are None 03/20/2025 02:24:30.615 7fbfeec4f588 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-2925-1 as ['VrouterAgent'] 03/20/2025 02:24:30.616 7fbff638c828 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.24 object_type = vrouter request_url = http://10.0.0.24:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 2490 response_size_objects = 1 response_size_bytes = 104 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-2925-1. >> 03/20/2025 02:24:31.012 7fbfeec4f588 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABn23xe-5xakVf0lceCqi7Twp7MT0mWk30I7us7rnkE8eMqejSsEFte0fVH9lJXTGNn6v0PP3fqJDdUG89alAmNX6_Tn1_m_H7rWjD7HvXpyVsX1ltDhPWvOSN9ZMo5-hwKGsAkZTBJjN9FiDuuva3NPIaJD1kc8wxRDnrHsQVSPaswyOQ 03/20/2025 02:24:31.013 7fbfeec4f588 [contrail-analytics-api] [DEBUG]: user resources are None 03/20/2025 02:24:31.016 7fbfeec4f588 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-2925-1 as ['NodeStatus'] 03/20/2025 02:24:31.017 7fbff432f2e8 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.24 object_type = vrouter request_url = http://10.0.0.24:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 4292 response_size_objects = 1 response_size_bytes = 922 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-2925-1. >> 03/20/2025 02:25:31.589 7fbff4362ac8 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABn23ybkjpYU9qsJlE_4X5uqQwC6O6hpuTDeed6cd3h9e6OlnaxuE-l1fnmyngdz-MSotuPjGF02zCknwOcaqVDFtOSTWuh8YYEipc0RGTZuGXeOxIunfo7d7TsTQTDHSH-3EcXjn5pNeG3VpaqR7mJCVSQm3mWM74wRoNKmcCNE_LpVoc 03/20/2025 02:25:31.590 7fbff4362ac8 [contrail-analytics-api] [DEBUG]: user resources are None 03/20/2025 02:25:31.592 7fbff4362ac8 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-2925-1 as ['VrouterAgent'] 03/20/2025 02:25:31.593 7fbff7b528d0 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.24 object_type = vrouter request_url = http://10.0.0.24:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 2886 response_size_objects = 1 response_size_bytes = 104 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-2925-1. >> 03/20/2025 02:25:32.342 7fbff4362ac8 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABn23ychj7CXqGz8x1PAJfijTSKlQAlUSJE_smLrfYcmmGQNo0XpMWiUPMJ6yf12Bl_IlaO5utg--Re0J7Rx0xO0g673-M86IqOWKGL1_bU-tyWHCNNpuPgPtxjyB3VAkAoIiGwwzJU59lLJrp_je1M9Hhrw2H3gnQ2s3ycI2-2ZqKrrRA 03/20/2025 02:25:32.342 7fbff4362ac8 [contrail-analytics-api] [DEBUG]: user resources are None 03/20/2025 02:25:32.345 7fbff4362ac8 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-2925-1 as ['NodeStatus'] 03/20/2025 02:25:32.346 7fbff58a16d8 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.24 object_type = vrouter request_url = http://10.0.0.24:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 3547 response_size_objects = 1 response_size_bytes = 922 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-2925-1. >> 03/20/2025 02:26:35.039 7fbff4362ac8 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABn23za7PmCvHzs6rRBUi_2EzEf0bYHiXqLeotEPwW0aOhkziDV1CNMC6dGIJnYEDRbCyocvdzCdYzwsY7kmhWoyE_lOQc_ibK5-kipXY9cKN5_VUZPWJ83xd7bUSIzcSYptaD3HOhmDVFe90BD6Qj38lpb-0tfhzjRnrPfwenEzeb-JrI 03/20/2025 02:26:35.039 7fbff4362ac8 [contrail-analytics-api] [DEBUG]: user resources are None 03/20/2025 02:26:35.042 7fbff4362ac8 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-2925-1 as ['VrouterAgent'] 03/20/2025 02:26:35.042 7fbff432f780 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.24 object_type = vrouter request_url = http://10.0.0.24:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 2736 response_size_objects = 1 response_size_bytes = 104 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-2925-1. >> 03/20/2025 02:26:35.465 7fbff4362ac8 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABn23zbzr7SMbA27toQtn7XH7u3vrH9jD_n0EIzQIRDlrDZ8wr32o5A69BOHUl9bu7aQ-DBci129wV-EyYnFPpUq3sF1AVp4uD5HiXySZ5YMBTehl5VbUlDxVR4NBJpx-qcrPmIvqNhjWLEx0WuoCk2iCe5aG4mNYmOy4DKqrerGy1ltFg 03/20/2025 02:26:35.465 7fbff4362ac8 [contrail-analytics-api] [DEBUG]: user resources are None 03/20/2025 02:26:35.468 7fbff4362ac8 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-2925-1 as ['NodeStatus'] 03/20/2025 02:26:35.468 7fbff5872e10 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.24 object_type = vrouter request_url = http://10.0.0.24:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 2540 response_size_objects = 1 response_size_bytes = 922 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-2925-1. >> 03/20/2025 02:27:33.865 7fbff4362ac8 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 03/20/2025 02:27:36.700 7fbff4362ac8 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABn230Yq9BEJxSS6AgQQyPnvyfi6JTH8f7e5oD1vMdFcJQp_10OqYGHGz_50PjzIeYB3wK3smgLzuaHLp-vcNkmolGw6r_p_aAryu1Y5qNcoLaLbwO-fLCUAUErvf9cR6hQW8QC0wyO4ui74m1TI3vO8ekLlDR5GDzaqVyg4Yt1OQgHlR8 03/20/2025 02:27:36.700 7fbff4362ac8 [contrail-analytics-api] [DEBUG]: user resources are None 03/20/2025 02:27:36.702 7fbff4362ac8 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-2925-1 as ['VrouterAgent'] 03/20/2025 02:27:36.703 7fbff5839978 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.24 object_type = vrouter request_url = http://10.0.0.24:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 2252 response_size_objects = 1 response_size_bytes = 104 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-2925-1. >> 03/20/2025 02:27:37.070 7fbff4362ac8 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABn230ZvzhK3MKHOG5X4HHWgFpe3i9qp8uuLqGShlb9gbbII34WK8apA5XhSdyQgp12Iw7GK0ou2-qzNSai4zKwdAabLotOiZqkarNiceCVbFSl-QILGx2AEJBaXusKKwVwbFAc_wiI-1T2Djyf57075jEaiC8dAA6tZ8KN-YbQ9Hyuqe0 03/20/2025 02:27:37.070 7fbff4362ac8 [contrail-analytics-api] [DEBUG]: user resources are None 03/20/2025 02:27:37.073 7fbff4362ac8 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-2925-1 as ['NodeStatus'] 03/20/2025 02:27:37.073 7fbff432c6d8 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.24 object_type = vrouter request_url = http://10.0.0.24:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 3392 response_size_objects = 1 response_size_bytes = 922 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-2925-1. >>