06/26/2025 02:09:42.413 7fa699bbcec8 [contrail-analytics-api] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 06/26/2025 02:09:42.413 7fa699bbcec8 [contrail-analytics-api] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 06/26/2025 02:09:42.413 7fa699bbcec8 [contrail-analytics-api] [INFO]: SANDESH: Flow Logging: [None] -> [False] 06/26/2025 02:09:42.413 7fa699bbcec8 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/26/2025 02:09:42.439 7fa699bbcec8 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 06/26/2025 02:09:42.440 7fa6904a7438 [contrail-analytics-api] [ERROR]: Cannot write http_port 8090 to /tmp/contrail-analytics-api.0.http_port 06/26/2025 02:09:42.440 7fa6904a7438 [contrail-analytics-api] [ERROR]: Starting Introspect on HTTP Port 8090 06/26/2025 02:09:42.440 7fa69049dd68 [contrail-analytics-api] [INFO]: Processing event[EvStart] in state[none] 06/26/2025 02:09:42.440 7fa69049dd68 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 06/26/2025 02:09:42.442 7fa69049dd68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 06/26/2025 02:09:42.442 7fa69049dd68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/26/2025 02:09:42.442 7fa69049dd68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3555-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.65:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, ] description = >>, ] >> 06/26/2025 02:09:42.442 7fa69049dd68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/26/2025 02:09:42.442 7fa69049dd68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/26/2025 02:09:42.442 7fa69049dd68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3555-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.65:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.65:6379 server_addrs = [ 10.0.0.65:6379, ] status = Initializing description = Redis Instance initialized >>, ] description = Redis-UVE:10.0.0.65:6379[Redis Instance initialized] connection down >>, ] >> 06/26/2025 02:09:42.442 7fa69049dd68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/26/2025 02:09:42.442 7fa69049dd68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/26/2025 02:09:42.442 7fa69049dd68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3555-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.65:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.65:6379 server_addrs = [ 10.0.0.65:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.65:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, ] description = Redis-UVE:10.0.0.65:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized] connection down >>, ] >> 06/26/2025 02:09:42.442 7fa69049dd68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/26/2025 02:09:42.443 7fa69049dd68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/26/2025 02:09:42.443 7fa69049dd68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] AnalyticsApiInfoUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3555-1. analytics_node_ip = { rest_api_ip : 10.0.0.65host_ip : 10.0.0.65 } >> 06/26/2025 02:09:42.443 7fa69049dd68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/26/2025 02:09:42.444 7fa69049dd68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/26/2025 02:09:42.444 7fa69049dd68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3555-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.65:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.65:6379 server_addrs = [ 10.0.0.65:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.65:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Redis-UVE:10.0.0.65:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 06/26/2025 02:09:42.444 7fa69049dd68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/26/2025 02:09:42.444 7fa69049dd68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/26/2025 02:09:42.444 7fa69049dd68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3555-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1750903782440880 collector_name = collector_ip = collector_list = [ 10.0.0.65:8086, ] >> sm_queue_count = 5 max_sm_queue_count = 5 >> 06/26/2025 02:09:42.444 7fa69049dd68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/26/2025 02:09:42.445 7fa697731c18 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 06/26/2025 02:09:42.453 7fa6962ffb70 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/26/2025 02:09:42.453 7fa6962ffb70 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3555-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.65:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.65:6379 server_addrs = [ 10.0.0.65:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.65:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.65:8082, ] status = Initializing description = Connection to API Server initialized >>, ] description = Redis-UVE:10.0.0.65:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[Connection to API Server initialized] connection down >>, ] >> 06/26/2025 02:09:42.453 7fa6962ffb70 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/26/2025 02:09:42.456 7fa6962602e8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/26/2025 02:09:42.456 7fa6962602e8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3555-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.65:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.65:6379 server_addrs = [ 10.0.0.65:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.65:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.65:8082, ] status = Initializing description = Connection to API Server initialized >>, ] description = Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[Connection to API Server initialized] connection down >>, ] >> 06/26/2025 02:09:42.457 7fa6962602e8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/26/2025 02:09:42.462 7fa699154978 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/26/2025 02:09:42.463 7fa699154978 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3555-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.65:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.65:6379 server_addrs = [ 10.0.0.65:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.65:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.65:8082, ] status = Up description = Connection to API Server established >>, ] description = Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 06/26/2025 02:09:42.464 7fa699154978 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/26/2025 02:09:42.464 7fa6962c58d0 [contrail-analytics-api] [INFO]: Analytics Discovery listen CONNECTED 06/26/2025 02:09:42.464 7fa6962c58d0 [contrail-analytics-api] [INFO]: Analytics Discovery to publish None 06/26/2025 02:09:42.464 7fa699beeeb8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/26/2025 02:09:42.465 7fa699beeeb8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3555-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.65:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.65:6379 server_addrs = [ 10.0.0.65:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.65:2181, ] status = Up description = Connection to Zookeeper re-established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.65:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 06/26/2025 02:09:42.465 7fa699beeeb8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/26/2025 02:09:42.465 7fa699beeeb8 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/26/2025 02:09:42.466 7fa699beeeb8 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3555-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.65:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.65:6379 server_addrs = [ 10.0.0.65:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.65:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.65:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 06/26/2025 02:09:42.466 7fa699beeeb8 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/26/2025 02:09:42.473 7fa697731c18 [contrail-analytics-api] [INFO]: Analytics Discovery Watcher AlarmGenerator Children [] 06/26/2025 02:09:42.475 7fa697731c18 [contrail-analytics-api] [INFO]: Analytics Discovery OpServer reconnect 06/26/2025 02:09:42.475 7fa697731c18 [contrail-analytics-api] [INFO]: ensure /analytics-discovery-/OpServer 06/26/2025 02:09:42.476 7fa697731c18 [contrail-analytics-api] [INFO]: zk state CONNECTED (CONNECTED) 06/26/2025 02:09:42.480 7fa697731c18 [contrail-analytics-api] [INFO]: check for /analytics-discovery-/OpServer/cn-jenkins-deploy-platform-ansible-os-3555-1.-0 06/26/2025 02:09:46.444 7fa6962908d0 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/26/2025 02:09:46.445 7fa6962908d0 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 06/26/2025 02:09:46.445 7fa6962908d0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/26/2025 02:09:46.445 7fa6962908d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/26/2025 02:09:46.445 7fa6962908d0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3555-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.65:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.65:6379 server_addrs = [ 10.0.0.65:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.65:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.65:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/26/2025 02:09:46.445 7fa6962908d0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/26/2025 02:09:46.445 7fa6962908d0 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 06/26/2025 02:09:46.445 7fa6962908d0 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 06/26/2025 02:09:46.445 7fa6962908d0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 06/26/2025 02:09:46.445 7fa6962908d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 06/26/2025 02:09:46.446 7fa6962908d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 06/26/2025 02:09:46.446 7fa696290390 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 06/26/2025 02:09:46.446 7fa696290390 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 06/26/2025 02:09:46.449 7fa69049dac8 [contrail-analytics-api] [DEBUG]: Extracted sandesh length: 0000001017 06/26/2025 02:09:46.449 7fa69049dac8 [contrail-analytics-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 06/26/2025 02:09:46.449 7fa6925e48d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 06/26/2025 02:09:46.449 7fa6925e48d0 [contrail-analytics-api] [DEBUG]: Number of uve types in sandesh control message is 0 06/26/2025 02:09:46.449 7fa6925e48d0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 06/26/2025 02:09:46.450 7fa6925e48d0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/26/2025 02:09:46.450 7fa6925e48d0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 06/26/2025 02:09:46.450 7fa6925e48d0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 06/26/2025 02:09:46.450 7fa696290390 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 06/26/2025 02:09:46.451 7fa696290390 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 06/26/2025 02:09:49.247 7fa6925e48d0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoXKvsbDSeYqMnhya4x19RGXG2Pkog_JOlHSeX5HjLqYWK13K78UiTpPSdLkhNiWelLob7KC7MgjJ1E0nTzUDq2Ra7bzqJoxfdzHqIEu9JbI0VhwvZ_EP3dOgKm1IQ4Id-aCeskIxDDGfI1i1vxGQ3mfjn6dhkPJqHLvbraHAkRNcY8EI 06/26/2025 02:09:49.247 7fa6925e48d0 [contrail-analytics-api] [DEBUG]: user resources are None 06/26/2025 02:09:49.248 7fa6962c1978 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.65 object_type = vrouter request_url = http://10.0.0.65:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 1214 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3555-1. >> 06/26/2025 02:09:49.608 7fa6925e48d0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoXKvtekLjOtsL4oYcl_hLAooiS6Gnb2z8jWzKL_nLVs2Fdk7uMEJMN3EkGoQeRw0W1onnuN_9Mx0P2_N4rPtvUnY0PWlPLCgNgOnJnvWdGo6CHQAwtEyw2kybg9Zea9uBCyisfDirlWWbddkElMSxDFh8E8V-ugx_sOwFO6qoYooGJXE 06/26/2025 02:09:49.608 7fa6925e48d0 [contrail-analytics-api] [DEBUG]: user resources are None 06/26/2025 02:09:49.610 7fa699154978 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.65 object_type = vrouter request_url = http://10.0.0.65:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 1633 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3555-1. >> 06/26/2025 02:09:54.413 7fa69049dac8 [contrail-analytics-api] [DEBUG]: Extracted sandesh length: 0000001436 06/26/2025 02:09:54.420 7fa69049dac8 [contrail-analytics-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 06/26/2025 02:09:54.420 7fa6962fd780 [contrail-analytics-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 06/26/2025 02:09:54.420 7fa6962fd780 [contrail-analytics-api] [DEBUG]: Number of uve types in sandesh control message is 3 06/26/2025 02:09:54.420 7fa6962fd780 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 06/26/2025 02:09:54.420 7fa6962fd780 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/26/2025 02:09:54.421 7fa6962fd780 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 06/26/2025 02:09:54.421 7fa699154978 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 06/26/2025 02:09:54.421 7fa699154978 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 06/26/2025 02:09:57.651 7fa6962c5780 [contrail-analytics-api] [INFO]: Analytics Discovery Watcher AlarmGenerator Children ['cn-jenkins-deploy-platform-ansible-os-3555-1.-0'] 06/26/2025 02:10:02.484 7fa697731c18 [contrail-analytics-api] [INFO]: Analytics Discovery OpServer reconnect 06/26/2025 02:10:02.484 7fa697731c18 [contrail-analytics-api] [INFO]: ensure /analytics-discovery-/OpServer 06/26/2025 02:10:02.484 7fa697731c18 [contrail-analytics-api] [INFO]: zk state CONNECTED (CONNECTED) 06/26/2025 02:10:02.486 7fa697731c18 [contrail-analytics-api] [INFO]: check for /analytics-discovery-/OpServer/cn-jenkins-deploy-platform-ansible-os-3555-1.-0 06/26/2025 02:10:02.490 7fa697731c18 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-3555-1.-0, data b'{"ip-address": "10.0.0.65", "instance-id": "0", "redis-ip": "10.0.0.65", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{}"}', event None 06/26/2025 02:10:02.491 7fa697731c18 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-3555-1.-0, data OrderedDict([('instance-id', '0'), ('ip-address', '10.0.0.65'), ('partitions', '{}'), ('redis-agg-db', 7), ('redis-ip', '10.0.0.65'), ('redis-port', '6379')]), event GET 06/26/2025 02:10:06.748 7fa6962c5780 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-3555-1.-0, data b'{"ip-address": "10.0.0.65", "instance-id": "0", "redis-ip": "10.0.0.65", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{}"}', event WatchedEvent(type='CHANGED', state='CONNECTED', path='/analytics-discovery-/AlarmGenerator/cn-jenkins-deploy-platform-ansible-os-3555-1.-0') 06/26/2025 02:10:07.809 7fa6962c5780 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-3555-1.-0, data b'{"ip-address": "10.0.0.65", "instance-id": "0", "redis-ip": "10.0.0.65", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{\\"0\\": 1750903806992847, \\"1\\": 1750903807003802, \\"2\\": 1750903807031599, \\"3\\": 1750903807055488, \\"4\\": 1750903807073202, \\"5\\": 1750903807092278, \\"6\\": 1750903807106564, \\"7\\": 1750903807131633, \\"8\\": 1750903807158169, \\"9\\": 1750903807171802, \\"10\\": 1750903807189716, \\"11\\": 1750903807210081, \\"12\\": 1750903807226349, \\"13\\": 1750903807263949, \\"14\\": 1750903807288894, \\"15\\": 1750903807310474, \\"16\\": 1750903807343401, \\"17\\": 1750903807368376, \\"18\\": 1750903807393306, \\"19\\": 1750903807439518, \\"20\\": 1750903807468808, \\"21\\": 1750903807496976, \\"22\\": 1750903807532909, \\"23\\": 1750903807563614, \\"24\\": 1750903807580992, \\"25\\": 1750903807611668, \\"26\\": 1750903807648285, \\"28\\": 1750903807666110, \\"27\\": 1750903807666288}"}', event WatchedEvent(type='CHANGED', state='CONNECTED', path='/analytics-discovery-/AlarmGenerator/cn-jenkins-deploy-platform-ansible-os-3555-1.-0') 06/26/2025 02:10:08.782 7fa6962c5780 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-3555-1.-0, data b'{"ip-address": "10.0.0.65", "instance-id": "0", "redis-ip": "10.0.0.65", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{\\"0\\": 1750903806992847, \\"1\\": 1750903807003802, \\"2\\": 1750903807031599, \\"3\\": 1750903807055488, \\"4\\": 1750903807073202, \\"5\\": 1750903807092278, \\"6\\": 1750903807106564, \\"7\\": 1750903807131633, \\"8\\": 1750903807158169, \\"9\\": 1750903807171802, \\"10\\": 1750903807189716, \\"11\\": 1750903807210081, \\"12\\": 1750903807226349, \\"13\\": 1750903807263949, \\"14\\": 1750903807288894, \\"15\\": 1750903807310474, \\"16\\": 1750903807343401, \\"17\\": 1750903807368376, \\"18\\": 1750903807393306, \\"19\\": 1750903807439518, \\"20\\": 1750903807468808, \\"21\\": 1750903807496976, \\"22\\": 1750903807532909, \\"23\\": 1750903807563614, \\"24\\": 1750903807580992, \\"25\\": 1750903807611668, \\"26\\": 1750903807648285, \\"28\\": 1750903807666110, \\"27\\": 1750903807666288, \\"29\\": 1750903807744141}"}', event WatchedEvent(type='CHANGED', state='CONNECTED', path='/analytics-discovery-/AlarmGenerator/cn-jenkins-deploy-platform-ansible-os-3555-1.-0') 06/26/2025 02:10:49.955 7fa6962c1630 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoXKwpiG70ONwpTmm_P4POu1-jeA57TRjBwGFZc5nBVf-_TKDaZntH-rDm35vGNkKNaTjaOQTYPtzue1hEjkEnsJfMllGkHXGdZ96h-A7Lo1gviGqqMcadxQuk1-9dRFFYnQamcuZDpQAUlPE4L8dIg4-Feaj6CzaxgvfaCVjUjOgZBW8 06/26/2025 02:10:49.955 7fa6962c1630 [contrail-analytics-api] [DEBUG]: user resources are None 06/26/2025 02:10:49.956 7fa69628ef60 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.65 object_type = vrouter request_url = http://10.0.0.65:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 1276 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3555-1. >> 06/26/2025 02:10:50.300 7fa6962c1630 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoXKwqESBITJEPqzoj-FaX-eMhDrsoirwoDzJBWhEBB1Zufitili6FnhgTOd8XQ04Jy0uuwK3i4FUNeAk1BxxafWY66KpKbZK2B55WMaI6ftUAGF7_lan-ILLQdXA_YFvawPALBGFVFywwUNJ8rqOuOg2bpfA-7UzwdX15rSVKGQsdBm0 06/26/2025 02:10:50.300 7fa6962c1630 [contrail-analytics-api] [DEBUG]: user resources are None 06/26/2025 02:10:50.302 7fa6977370f0 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.65 object_type = vrouter request_url = http://10.0.0.65:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 1758 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3555-1. >> 06/26/2025 02:11:40.935 7fa6962c1630 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/26/2025 02:11:43.048 7fa6962c1630 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 06/26/2025 02:11:50.664 7fa6962c1630 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoXKxmXSRXQkN8vqCD4SS2XTj09Zk0aIMEtsKVdGq_Vz3DmOCip2UNopzuNmtRjWr1X2ZvfvRZVxzyi_1SubxUJmS8aSVuiN5hH8z1t8iMn_6I4DtdmMbG5ur_cj1mzMXqNqZDum6QmfOBGP01y3Uvzmk9QvypZvrnqaW0O3sg_uGw0Pc 06/26/2025 02:11:50.664 7fa6962c1630 [contrail-analytics-api] [DEBUG]: user resources are None 06/26/2025 02:11:50.665 7fa6962c1978 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.65 object_type = vrouter request_url = http://10.0.0.65:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 906 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3555-1. >> 06/26/2025 02:11:51.012 7fa6962c1630 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoXKxmyH_KB-x0AmbxefmJZvJydE7nogSjo_Ley1fU16yLlIDbbAM6dlTLv8jC3ZOBFiKftEN2ChNQizYOC3fHXO2hyGIoEaLhVfByGfJpN-cyR_dJh0DjwZzqzmiHNNZd8TNmgV6x_5XDeIOA6B6XvdeFeukEktAU-dSUc6n4xd76Frk 06/26/2025 02:11:51.012 7fa6962c1630 [contrail-analytics-api] [DEBUG]: user resources are None 06/26/2025 02:11:51.015 7fa6962c1630 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3555-1 as ['NodeStatus'] 06/26/2025 02:11:51.016 7fa696260438 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.65 object_type = vrouter request_url = http://10.0.0.65:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 3766 response_size_objects = 1 response_size_bytes = 930 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3555-1. >> 06/26/2025 02:12:51.464 7fa6962c1630 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoXKyjHGbv5f2UAm4LPHpfbBWFRDBNKesAoJaC71WXYNs4HLkQaK5VbkvOkwNOo-tHF4dmLQgM01pHgvjL6OkmS43TNM-qZAS8wyBWD9LRbGG-Uznb3Yvp9z6EMp9Lgi8GUD7RUqQ6qAOxFJsiHNov1PbtWIpiHOeL8WVCryY0ePj_Y-Q 06/26/2025 02:12:51.464 7fa6962c1630 [contrail-analytics-api] [DEBUG]: user resources are None 06/26/2025 02:12:51.466 7fa6962c1630 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3555-1 as ['VrouterAgent'] 06/26/2025 02:12:51.466 7fa6962c5d68 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.65 object_type = vrouter request_url = http://10.0.0.65:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 2129 response_size_objects = 1 response_size_bytes = 104 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3555-1. >> 06/26/2025 02:12:51.835 7fa6962c1630 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoXKyjUxTapVX-HLsqaLjBeyNqIXTvl7BA6J6LUOayNgDOaestCvrY6RupVA0NpJeixp8SzRrtjC8PPPqq5ndGjmModIPiouVcX2nCWLgyT4PJA9-0AWse3McyNTgJ0qTPV5--IP0aHZAZwjhesg5cjlKN4n4eJ1YmiWZx43NVApi10Q8 06/26/2025 02:12:51.835 7fa6962c1630 [contrail-analytics-api] [DEBUG]: user resources are None 06/26/2025 02:12:51.837 7fa6962c1630 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3555-1 as ['NodeStatus'] 06/26/2025 02:12:51.838 7fa6962c5cc0 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.65 object_type = vrouter request_url = http://10.0.0.65:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 2529 response_size_objects = 1 response_size_bytes = 930 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3555-1. >> 06/26/2025 02:13:02.070 7fa6962c1630 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 06/26/2025 02:13:02.389 7fa6962c1630 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 06/26/2025 02:13:52.546 7fa6962c1630 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoXKzgSw34hEQwQwurYGAu0UZ018bHZZC6LgPNZ3ilkEEFBCzbaS8lUTA6meweEqQ15lTEEnjNt698IJGWZhsNHJSxCilZYe4mqwwIpsd7rqoZJ8mwx73-5A3dj5fKV1aRVZhOxK5nomn2mjduXbWiCpSvciUHcOJV-trhnTCB5t26-sM 06/26/2025 02:13:52.546 7fa6962c1630 [contrail-analytics-api] [DEBUG]: user resources are None 06/26/2025 02:13:52.549 7fa6962c1630 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3555-1 as ['VrouterAgent'] 06/26/2025 02:13:52.549 7fa69628e8d0 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.65 object_type = vrouter request_url = http://10.0.0.65:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 2767 response_size_objects = 1 response_size_bytes = 104 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3555-1. >> 06/26/2025 02:13:53.266 7fa6962c1630 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoXKzgLBPgb7TmTz-ZLcsSWQvC6-QHPcAE_LC95G-uhghzv9Kr58nNnY-ia2rn12Dxs4Y8Zfrewu95e2kjjqVb4r4S_x9jJKr-o4zbUCk0vGKDYVobZTqJmAJEDW3EV4mhQtY7Q7Ncx6oibSLyAAHGZmMWHBGflL_PrC-qTrCJEU-IVQE 06/26/2025 02:13:53.266 7fa6962c1630 [contrail-analytics-api] [DEBUG]: user resources are None 06/26/2025 02:13:53.270 7fa6962c1630 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3555-1 as ['NodeStatus'] 06/26/2025 02:13:53.270 7fa699a99eb8 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.65 object_type = vrouter request_url = http://10.0.0.65:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 3463 response_size_objects = 1 response_size_bytes = 930 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3555-1. >> 06/26/2025 02:14:55.092 7fa697731390 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoXK0fAGKBonLlfDTmjqtApBapxVdv-Ymgjzg0_zUXfonkAbSxCBYgNoHtBc8OgjAmYimLB3usb9HCUk_YDz2kWmDCNzs4aMhUtHVXm02sZDCRbK8IiJV02YH9iOf_SgUztD0Xi98qN-aBxUmEcvwtyEdUU68qP9-AxDS6VR3JJqBtJTQ 06/26/2025 02:14:55.092 7fa697731390 [contrail-analytics-api] [DEBUG]: user resources are None 06/26/2025 02:14:55.094 7fa697731390 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3555-1 as ['VrouterAgent'] 06/26/2025 02:14:55.094 7fa69845e0f0 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.65 object_type = vrouter request_url = http://10.0.0.65:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 2293 response_size_objects = 1 response_size_bytes = 104 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3555-1. >> 06/26/2025 02:14:55.431 7fa697731390 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABoXK0fuvHqJHVin3iUCn6yKawhwBCkO64zhOt4Ukm9zhsp2QAxksrubJA2hTrVoAd8d04YLDd3DV8wffaU-DF33oq3dgAUYYI3k-Xn6BtFWfuGh_Tjd1ojdmiXsp0YneY106XcvLZXy9iIpndbPyIE__XNaCgMav8dbyJVtVJi50BavTU 06/26/2025 02:14:55.431 7fa697731390 [contrail-analytics-api] [DEBUG]: user resources are None 06/26/2025 02:14:55.433 7fa697731390 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3555-1 as ['NodeStatus'] 06/26/2025 02:14:55.434 7fa699bb96d8 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.65 object_type = vrouter request_url = http://10.0.0.65:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 2626 response_size_objects = 1 response_size_bytes = 930 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3555-1. >> 06/26/2025 02:15:09.135 7fa697731390 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map