05/12/2025 02:18:12.042 7fa5184ecfc8 [contrail-schema] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 05/12/2025 02:18:12.042 7fa5184ecfc8 [contrail-schema] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 05/12/2025 02:18:12.042 7fa5184ecfc8 [contrail-schema] [INFO]: SANDESH: Flow Logging: [None] -> [False] 05/12/2025 02:18:12.043 7fa513c08198 [contrail-schema] [INFO]: Processing event[EvStart] in state[none] 05/12/2025 02:18:12.043 7fa513c08198 [contrail-schema] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 05/12/2025 02:18:12.043 7fa513c08198 [contrail-schema] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 05/12/2025 02:18:12.043 7fa513c08198 [contrail-schema] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 05/12/2025 02:18:12.044 7fa513c08198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:12.044 7fa513c08198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 05/12/2025 02:18:12.044 7fa513c08198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:12.044 7fa513c08198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:12.044 7fa513c08198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1747016292043676 collector_name = collector_ip = collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 05/12/2025 02:18:12.044 7fa513c08198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:12.110 7fa5184ecfc8 [contrail-schema] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.130:5673//'] 05/12/2025 02:18:12.118 7fa5184ecfc8 [contrail-schema] [WARNING]: RabbitMQ drainer connection down 05/12/2025 02:18:12.119 7fa516af5048 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:12.119 7fa516af5048 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 05/12/2025 02:18:12.119 7fa516af5048 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:12.119 7fa516af5048 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:12.119 7fa516af5048 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 05/12/2025 02:18:12.120 7fa516af5048 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:12.129 7fa5184ecfc8 [contrail-schema] [WARNING]: RabbitMQ drainer connection ESTABLISHED 05/12/2025 02:18:12.129 7fa516af5588 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:12.129 7fa516af5588 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 05/12/2025 02:18:12.129 7fa516af5588 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:12.142 7fa5184ecfc8 [contrail-schema] [WARNING]: RabbitMQ publish connection down 05/12/2025 02:18:12.142 7fa515b4a978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:12.143 7fa515b4a978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 05/12/2025 02:18:12.143 7fa515b4a978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:12.146 7fa5184ecfc8 [contrail-schema] [WARNING]: RabbitMQ publish connection ESTABLISHED 05/12/2025 02:18:12.147 7fa51ec90978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:12.147 7fa51ec90978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 05/12/2025 02:18:12.147 7fa51ec90978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:12.153 7fa5184ecfc8 [contrail-schema] [DEBUG]: Removed remained AMQP queue 05/12/2025 02:18:12.154 7fa515b66780 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:12.154 7fa515b66780 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Zookeeper:Zookeeper[] connection down >>, ] >> 05/12/2025 02:18:12.155 7fa515b66780 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:12.179 7fa5184ecfc8 [contrail-schema] [WARNING]: Waiting to be elected as master... 05/12/2025 02:18:12.179 7fa515ade780 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:12.179 7fa515ade780 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 05/12/2025 02:18:12.179 7fa515ade780 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:12.210 7fa5184ecfc8 [contrail-schema] [WARNING]: Elected master Schema Transformer node. Initializing... 05/12/2025 02:18:12.210 7fa5184ecfc8 [contrail-schema] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8087 05/12/2025 02:18:12.213 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add [config_updater.xml:/usr/local/lib/python3.6/site-packages/cfgm_common/uve/config_updater] to home page 05/12/2025 02:18:12.214 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add http request [/Snh_ConfigApiUpdateReq] 05/12/2025 02:18:12.215 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add [greenlets.xml:/usr/local/lib/python3.6/site-packages/cfgm_common/uve/greenlets] to home page 05/12/2025 02:18:12.215 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add http request [/Snh_GreenletObjectReq] 05/12/2025 02:18:12.216 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add [cpuinfo.xml:/usr/local/lib/python3.6/site-packages/cfgm_common/uve/nodeinfo/cpuinfo] to home page 05/12/2025 02:18:12.216 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add http request [/Snh_CpuLoadInfoReq] 05/12/2025 02:18:12.223 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add [st_introspect.xml:/usr/local/lib/python3.6/site-packages/schema_transformer/sandesh/st_introspect] to home page 05/12/2025 02:18:12.223 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add http request [/Snh_VnList] 05/12/2025 02:18:12.223 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add http request [/Snh_RoutingInstanceList] 05/12/2025 02:18:12.223 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add http request [/Snh_ServiceChainList] 05/12/2025 02:18:12.224 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add http request [/Snh_StObjectReq] 05/12/2025 02:18:12.226 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add [sandesh_alarm.xml:/usr/local/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_alarm] to home page 05/12/2025 02:18:12.227 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshAlarmCacheRequest] 05/12/2025 02:18:12.227 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshAlarmTypesRequest] 05/12/2025 02:18:12.227 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshAlarmAckRequest] 05/12/2025 02:18:12.228 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add [sandesh_ctrl.xml:/usr/local/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_ctrl] to home page 05/12/2025 02:18:12.229 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshCtrlClientToServer] 05/12/2025 02:18:12.229 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshCtrlServerToClient] 05/12/2025 02:18:12.232 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add [sandesh_trace.xml:/usr/local/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_trace] to home page 05/12/2025 02:18:12.232 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshTraceRequest] 05/12/2025 02:18:12.232 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshTraceBufferListRequest] 05/12/2025 02:18:12.233 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshTraceEnableDisableReq] 05/12/2025 02:18:12.233 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshTraceBufStatusReq] 05/12/2025 02:18:12.233 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshTraceBufferEnableDisableReq] 05/12/2025 02:18:12.236 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add [sandesh_uve.xml:/usr/local/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_uve] to home page 05/12/2025 02:18:12.237 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshMessageStatsReq] 05/12/2025 02:18:12.237 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsSet] 05/12/2025 02:18:12.237 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsStatus] 05/12/2025 02:18:12.237 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshSendingParamsSet] 05/12/2025 02:18:12.237 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshSendingParamsStatus] 05/12/2025 02:18:12.237 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsSet] 05/12/2025 02:18:12.237 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsReset] 05/12/2025 02:18:12.237 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsStatus] 05/12/2025 02:18:12.237 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshSendQueueSet] 05/12/2025 02:18:12.237 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshSendQueueStatus] 05/12/2025 02:18:12.237 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add http request [/Snh_CollectorInfoRequest] 05/12/2025 02:18:12.237 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshUVEDSConfReq] 05/12/2025 02:18:12.238 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshUVECacheReq] 05/12/2025 02:18:12.238 7fa5184ecfc8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshUVETypesReq] 05/12/2025 02:18:12.247 7fa515b02ac8 [contrail-schema] [ERROR]: Cannot write http_port 8087 to /tmp/contrail-schema.0.http_port 05/12/2025 02:18:12.247 7fa515b02ac8 [contrail-schema] [ERROR]: Starting Introspect on HTTP Port 8087 05/12/2025 02:18:12.247 7fa515b02cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:12.248 7fa515b02cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Initializing description = ApiServer >>, ] description = Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[ApiServer] connection down >>, ] >> 05/12/2025 02:18:12.248 7fa515b02cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:12.253 7fa515abad68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:12.253 7fa515abad68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Down description = ApiServer >>, ] description = Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[ApiServer] connection down >>, ] >> 05/12/2025 02:18:12.253 7fa515abad68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:16.045 7fa515a930f0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/12/2025 02:18:16.046 7fa515a930f0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 05/12/2025 02:18:16.046 7fa515a930f0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/12/2025 02:18:16.046 7fa515a930f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:18:16.046 7fa515a930f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Down description = ApiServer >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer] connection down >>, ] >> 05/12/2025 02:18:16.046 7fa515a930f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:18:16.046 7fa515a930f0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/12/2025 02:18:16.046 7fa515a930f0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/12/2025 02:18:16.047 7fa515a930f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:16.047 7fa515a930f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Down description = ApiServer >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer] connection down >>, ] >> 05/12/2025 02:18:16.047 7fa515a930f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:16.047 7fa515a930f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:16.047 7fa515a930f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1747016292043676 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/12/2025 02:18:16.047 7fa515a930f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:18.280 7fa5184ecfc8 [contrail-schema] [WARNING]: VNCCassandra started with driver cql 05/12/2025 02:18:18.281 7fa5184ecfc8 [contrail-schema] [WARNING]: initializing cassandra cluster 05/12/2025 02:18:18.281 7fa5184ecfc8 [contrail-schema] [WARNING]: CassandraDriverCQL.__init__Cluster before create 05/12/2025 02:18:18.281 7fa513c694e0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:18.281 7fa513c694e0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:18:18.281 7fa513c694e0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:18.281 7fa513c694e0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:18.282 7fa513c694e0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 05/12/2025 02:18:18.282 7fa513c694e0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:18.282 7fa5184ecfc8 [contrail-schema] [WARNING]: CassandraDriverCQL.__init__Cluster created 05/12/2025 02:18:18.308 7fa5184ecfc8 [contrail-schema] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 05/12/2025 02:18:18.310 7fa514b15438 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:18.310 7fa514b15438 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Initializing description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Zookeeper:Zookeeper[], Database:Cassandra[] connection down >>, ] >> 05/12/2025 02:18:18.310 7fa514b15438 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:18.314 7fa5184ecfc8 [contrail-schema] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 05/12/2025 02:18:18.314 7fa514b15240 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:18.314 7fa514b15240 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 05/12/2025 02:18:18.314 7fa514b15240 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:18.322 7fa5184ecfc8 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 05/12/2025 02:18:18.358 7fa5184ecfc8 [contrail-schema] [WARNING]: keyspace 'to_bgp_keyspace', created 05/12/2025 02:18:18.361 7fa5184ecfc8 [contrail-schema] [WARNING]: Zookeeper lock released. 05/12/2025 02:18:18.365 7fa5184ecfc8 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 05/12/2025 02:18:18.401 7fa5184ecfc8 [contrail-schema] [WARNING]: keyspace 'to_bgp_keyspace' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None} 05/12/2025 02:18:18.404 7fa5184ecfc8 [contrail-schema] [WARNING]: Zookeeper lock released. 05/12/2025 02:18:18.404 7fa5184ecfc8 [contrail-schema] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 05/12/2025 02:18:18.425 7fa5184ecfc8 [contrail-schema] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 05/12/2025 02:18:18.430 7fa5184ecfc8 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 05/12/2025 02:18:18.541 7fa5184ecfc8 [contrail-schema] [WARNING]: table 'route_target_table', created 05/12/2025 02:18:18.544 7fa5184ecfc8 [contrail-schema] [WARNING]: Zookeeper lock released. 05/12/2025 02:18:18.550 7fa5184ecfc8 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 05/12/2025 02:18:18.646 7fa5184ecfc8 [contrail-schema] [WARNING]: table 'route_target_table' fixed with properties {'gc_grace_seconds': 864000} 05/12/2025 02:18:18.649 7fa5184ecfc8 [contrail-schema] [WARNING]: Zookeeper lock released. 05/12/2025 02:18:18.654 7fa5184ecfc8 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 05/12/2025 02:18:18.767 7fa5184ecfc8 [contrail-schema] [WARNING]: table 'service_chain_ip_address_table', created 05/12/2025 02:18:18.769 7fa5184ecfc8 [contrail-schema] [WARNING]: Zookeeper lock released. 05/12/2025 02:18:18.774 7fa5184ecfc8 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 05/12/2025 02:18:18.881 7fa5184ecfc8 [contrail-schema] [WARNING]: table 'service_chain_ip_address_table' fixed with properties {'gc_grace_seconds': 864000} 05/12/2025 02:18:18.887 7fa5184ecfc8 [contrail-schema] [WARNING]: Zookeeper lock released. 05/12/2025 02:18:18.899 7fa5184ecfc8 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 05/12/2025 02:18:19.040 7fa5184ecfc8 [contrail-schema] [WARNING]: table 'service_chain_table', created 05/12/2025 02:18:19.045 7fa5184ecfc8 [contrail-schema] [WARNING]: Zookeeper lock released. 05/12/2025 02:18:19.049 7fa5184ecfc8 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 05/12/2025 02:18:19.149 7fa5184ecfc8 [contrail-schema] [WARNING]: table 'service_chain_table' fixed with properties {'gc_grace_seconds': 864000} 05/12/2025 02:18:19.152 7fa5184ecfc8 [contrail-schema] [WARNING]: Zookeeper lock released. 05/12/2025 02:18:19.156 7fa5184ecfc8 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 05/12/2025 02:18:19.284 7fa5184ecfc8 [contrail-schema] [WARNING]: table 'service_chain_uuid_table', created 05/12/2025 02:18:19.289 7fa5184ecfc8 [contrail-schema] [WARNING]: Zookeeper lock released. 05/12/2025 02:18:19.297 7fa5184ecfc8 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 05/12/2025 02:18:19.378 7fa5184ecfc8 [contrail-schema] [WARNING]: table 'service_chain_uuid_table' fixed with properties {'gc_grace_seconds': 864000} 05/12/2025 02:18:19.381 7fa5184ecfc8 [contrail-schema] [WARNING]: Zookeeper lock released. 05/12/2025 02:18:19.382 7fa514b1b0f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:19.382 7fa514b1b0f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:18:19.382 7fa514b1b0f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:19.398 7fa5184ecfc8 [contrail-schema] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.130:5673//'] 05/12/2025 02:18:19.399 7fa5184ecfc8 [contrail-schema] [WARNING]: RabbitMQ drainer connection down 05/12/2025 02:18:19.400 7fa514b226d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:19.400 7fa514b226d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 05/12/2025 02:18:19.400 7fa514b226d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:19.400 7fa514b226d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:19.400 7fa514b226d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Down description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 05/12/2025 02:18:19.400 7fa514b226d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:19.420 7fa5184ecfc8 [contrail-schema] [WARNING]: RabbitMQ drainer connection ESTABLISHED 05/12/2025 02:18:19.420 7fa515ae7240 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:19.420 7fa515ae7240 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:18:19.420 7fa515ae7240 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:19.438 7fa5184ecfc8 [contrail-schema] [WARNING]: RabbitMQ publish connection down 05/12/2025 02:18:19.438 7fa514b4b780 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:19.438 7fa514b4b780 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Down description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 05/12/2025 02:18:19.439 7fa514b4b780 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:19.441 7fa5184ecfc8 [contrail-schema] [WARNING]: RabbitMQ publish connection ESTABLISHED 05/12/2025 02:18:19.441 7fa514b68828 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:19.441 7fa514b68828 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:18:19.441 7fa514b68828 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:19.442 7fa515ae7240 [contrail-schema] [WARNING]: RabbitMQ publish connection down 05/12/2025 02:18:19.442 7fa514b18198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:19.443 7fa514b18198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Down description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 05/12/2025 02:18:19.443 7fa514b18198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:19.445 7fa515ae7240 [contrail-schema] [WARNING]: RabbitMQ publish connection ESTABLISHED 05/12/2025 02:18:19.445 7fa514b2b048 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:19.445 7fa514b2b048 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:18:19.445 7fa514b2b048 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:20.047 7fa514b1a0f0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/12/2025 02:18:20.048 7fa514b1a0f0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 05/12/2025 02:18:20.048 7fa514b1a0f0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/12/2025 02:18:20.048 7fa514b1a0f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:18:20.048 7fa514b1a0f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/12/2025 02:18:20.048 7fa514b1a0f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:18:20.048 7fa514b1a0f0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/12/2025 02:18:20.048 7fa514b1a0f0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/12/2025 02:18:20.049 7fa514b1a0f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:20.049 7fa514b1a0f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:18:20.049 7fa514b1a0f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:20.049 7fa514b1a0f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:20.049 7fa514b1a0f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1747016292043676 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/12/2025 02:18:20.049 7fa514b1a0f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:20.380 7fa5184ecfc8 [contrail-schema] [INFO]: GlobalSystemConfigST - REINIT Start 05/12/2025 02:18:20.389 7fa5184ecfc8 [contrail-schema] [INFO]: GlobalSystemConfigST - REINIT Complete 05/12/2025 02:18:20.389 7fa5184ecfc8 [contrail-schema] [INFO]: PhysicalRouterST - REINIT Start 05/12/2025 02:18:20.390 7fa5184ecfc8 [contrail-schema] [INFO]: PhysicalRouterST - REINIT Complete 05/12/2025 02:18:20.390 7fa5184ecfc8 [contrail-schema] [INFO]: BgpRouterST - REINIT Start 05/12/2025 02:18:20.391 7fa5184ecfc8 [contrail-schema] [INFO]: BgpRouterST - REINIT Complete 05/12/2025 02:18:20.391 7fa5184ecfc8 [contrail-schema] [INFO]: BgpvpnST - REINIT Start 05/12/2025 02:18:20.392 7fa5184ecfc8 [contrail-schema] [INFO]: BgpvpnST - REINIT Complete 05/12/2025 02:18:20.392 7fa5184ecfc8 [contrail-schema] [INFO]: LogicalRouterST - REINIT Start 05/12/2025 02:18:20.393 7fa5184ecfc8 [contrail-schema] [INFO]: LogicalRouterST - REINIT Complete 05/12/2025 02:18:21.129 7fa5184ecfc8 [contrail-schema] [INFO]: RouteTargetST - REINIT Start 05/12/2025 02:18:21.134 7fa5184ecfc8 [contrail-schema] [INFO]: RouteTargetST - REINIT Complete 05/12/2025 02:18:21.135 7fa5184ecfc8 [contrail-schema] [DEBUG]: VirtualNetworkST - REINIT Start 05/12/2025 02:18:21.135 7fa5184ecfc8 [contrail-schema] [DEBUG]: VirtualNetworkST - REINIT Complete 05/12/2025 02:18:21.135 7fa5184ecfc8 [contrail-schema] [DEBUG]: VirtualNetworkST - REINIT Start 05/12/2025 02:18:21.135 7fa5184ecfc8 [contrail-schema] [DEBUG]: VirtualNetworkST - REINIT Complete 05/12/2025 02:18:21.135 7fa5184ecfc8 [contrail-schema] [DEBUG]: VirtualNetworkST - REINIT Start 05/12/2025 02:18:21.136 7fa5184ecfc8 [contrail-schema] [DEBUG]: VirtualNetworkST - REINIT Complete 05/12/2025 02:18:21.136 7fa5184ecfc8 [contrail-schema] [DEBUG]: VirtualNetworkST - REINIT Start 05/12/2025 02:18:21.136 7fa5184ecfc8 [contrail-schema] [DEBUG]: VirtualNetworkST - REINIT Complete 05/12/2025 02:18:21.136 7fa5184ecfc8 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Start 05/12/2025 02:18:21.136 7fa5184ecfc8 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Complete 05/12/2025 02:18:21.136 7fa5184ecfc8 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Start 05/12/2025 02:18:21.279 7fa5184ecfc8 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Complete 05/12/2025 02:18:21.280 7fa5184ecfc8 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Start 05/12/2025 02:18:21.440 7fa5184ecfc8 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Complete 05/12/2025 02:18:21.440 7fa5184ecfc8 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Start 05/12/2025 02:18:21.611 7fa5184ecfc8 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Complete 05/12/2025 02:18:21.612 7fa5184ecfc8 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Start 05/12/2025 02:18:21.612 7fa5184ecfc8 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Complete 05/12/2025 02:18:21.612 7fa5184ecfc8 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Start 05/12/2025 02:18:24.051 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/12/2025 02:18:24.052 7fa514afe630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 05/12/2025 02:18:24.052 7fa514afe630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/12/2025 02:18:24.052 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:18:24.052 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/12/2025 02:18:24.052 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:18:24.052 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/12/2025 02:18:24.053 7fa514afe630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/12/2025 02:18:24.053 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:24.053 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:18:24.053 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:24.053 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:24.053 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1747016292043676 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/12/2025 02:18:24.053 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:28.055 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/12/2025 02:18:28.056 7fa514afe630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 05/12/2025 02:18:28.056 7fa514afe630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/12/2025 02:18:28.056 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:18:28.056 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/12/2025 02:18:28.056 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:18:28.056 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/12/2025 02:18:28.056 7fa514afe630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/12/2025 02:18:28.057 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:28.057 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:18:28.057 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:28.057 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:28.057 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1747016292043676 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/12/2025 02:18:28.057 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:32.059 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/12/2025 02:18:32.060 7fa514afe630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 05/12/2025 02:18:32.060 7fa514afe630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/12/2025 02:18:32.060 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:18:32.061 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/12/2025 02:18:32.061 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:18:32.061 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/12/2025 02:18:32.061 7fa514afe630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/12/2025 02:18:32.061 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:32.061 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:18:32.061 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:32.061 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:32.061 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1747016292043676 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/12/2025 02:18:32.061 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:36.062 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/12/2025 02:18:36.063 7fa514afe630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 05/12/2025 02:18:36.063 7fa514afe630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/12/2025 02:18:36.063 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:18:36.063 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/12/2025 02:18:36.063 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:18:36.064 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/12/2025 02:18:36.064 7fa514afe630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/12/2025 02:18:36.064 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:36.064 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:18:36.064 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:36.064 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:36.064 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1747016292043676 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/12/2025 02:18:36.064 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:40.067 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/12/2025 02:18:40.068 7fa514afe630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 05/12/2025 02:18:40.068 7fa514afe630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/12/2025 02:18:40.068 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:18:40.069 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/12/2025 02:18:40.069 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:18:40.069 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/12/2025 02:18:40.069 7fa514afe630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/12/2025 02:18:40.069 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:40.069 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:18:40.069 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:40.069 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:40.069 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1747016292043676 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/12/2025 02:18:40.070 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:44.072 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/12/2025 02:18:44.073 7fa514afe630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 05/12/2025 02:18:44.073 7fa514afe630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/12/2025 02:18:44.073 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:18:44.073 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/12/2025 02:18:44.074 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:18:44.074 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/12/2025 02:18:44.074 7fa514afe630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/12/2025 02:18:44.074 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:44.074 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:18:44.074 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:44.074 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:44.074 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1747016292043676 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/12/2025 02:18:44.074 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:48.074 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/12/2025 02:18:48.075 7fa514afe630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 05/12/2025 02:18:48.075 7fa514afe630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/12/2025 02:18:48.075 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:18:48.075 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/12/2025 02:18:48.075 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:18:48.075 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/12/2025 02:18:48.076 7fa514afe630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/12/2025 02:18:48.076 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:48.076 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:18:48.076 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:48.076 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:48.076 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1747016292043676 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/12/2025 02:18:48.076 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:52.079 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/12/2025 02:18:52.081 7fa514afe630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 05/12/2025 02:18:52.081 7fa514afe630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/12/2025 02:18:52.081 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:18:52.081 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/12/2025 02:18:52.081 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:18:52.081 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/12/2025 02:18:52.082 7fa514afe630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/12/2025 02:18:52.082 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:52.082 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:18:52.082 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:52.082 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:52.082 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1747016292043676 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/12/2025 02:18:52.082 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:56.083 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/12/2025 02:18:56.084 7fa514afe630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 05/12/2025 02:18:56.084 7fa514afe630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/12/2025 02:18:56.084 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:18:56.085 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/12/2025 02:18:56.085 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:18:56.085 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/12/2025 02:18:56.085 7fa514afe630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/12/2025 02:18:56.085 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:56.085 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:18:56.085 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:56.085 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:18:56.085 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1747016292043676 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/12/2025 02:18:56.085 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:00.086 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/12/2025 02:19:00.087 7fa514afe630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 05/12/2025 02:19:00.087 7fa514afe630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/12/2025 02:19:00.087 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:19:00.087 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/12/2025 02:19:00.087 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:19:00.087 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/12/2025 02:19:00.088 7fa514afe630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/12/2025 02:19:00.088 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:00.088 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:19:00.088 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:00.088 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:00.088 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1747016292043676 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/12/2025 02:19:00.088 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:04.088 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/12/2025 02:19:04.089 7fa514afe630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 05/12/2025 02:19:04.089 7fa514afe630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/12/2025 02:19:04.089 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:19:04.089 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/12/2025 02:19:04.089 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:19:04.089 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/12/2025 02:19:04.090 7fa514afe630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/12/2025 02:19:04.090 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:04.090 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:19:04.090 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:04.090 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:04.090 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1747016292043676 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/12/2025 02:19:04.090 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:08.092 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/12/2025 02:19:08.093 7fa514afe630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 05/12/2025 02:19:08.093 7fa514afe630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/12/2025 02:19:08.093 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:19:08.093 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/12/2025 02:19:08.093 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:19:08.093 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/12/2025 02:19:08.094 7fa514afe630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/12/2025 02:19:08.094 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:08.094 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:19:08.094 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:08.094 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:08.094 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1747016292043676 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/12/2025 02:19:08.094 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:12.093 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/12/2025 02:19:12.094 7fa514afe630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 05/12/2025 02:19:12.095 7fa514afe630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/12/2025 02:19:12.095 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:19:12.095 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/12/2025 02:19:12.095 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:19:12.095 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/12/2025 02:19:12.095 7fa514afe630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/12/2025 02:19:12.095 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:12.096 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:19:12.096 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:12.096 7fa514afe630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:12.096 7fa514afe630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1747016292043676 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/12/2025 02:19:12.096 7fa514afe630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:16.095 7fa5175270f0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/12/2025 02:19:16.096 7fa5175270f0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 05/12/2025 02:19:16.096 7fa5175270f0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/12/2025 02:19:16.096 7fa5175270f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:19:16.096 7fa5175270f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/12/2025 02:19:16.097 7fa5175270f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:19:16.097 7fa5175270f0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/12/2025 02:19:16.097 7fa5175270f0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/12/2025 02:19:16.097 7fa5175270f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:16.097 7fa5175270f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:19:16.097 7fa5175270f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:16.097 7fa5175270f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:16.097 7fa5175270f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1747016292043676 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/12/2025 02:19:16.097 7fa5175270f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:20.096 7fa5175270f0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/12/2025 02:19:20.097 7fa5175270f0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 05/12/2025 02:19:20.097 7fa5175270f0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/12/2025 02:19:20.097 7fa5175270f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:19:20.098 7fa5175270f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/12/2025 02:19:20.098 7fa5175270f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:19:20.098 7fa5175270f0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/12/2025 02:19:20.098 7fa5175270f0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/12/2025 02:19:20.098 7fa5175270f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:20.098 7fa5175270f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:19:20.098 7fa5175270f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:20.098 7fa5175270f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:20.098 7fa5175270f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1747016292043676 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/12/2025 02:19:20.099 7fa5175270f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:24.097 7fa514b49780 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/12/2025 02:19:24.098 7fa514b49780 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 05/12/2025 02:19:24.099 7fa514b49780 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/12/2025 02:19:24.099 7fa514b49780 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:19:24.099 7fa514b49780 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/12/2025 02:19:24.099 7fa514b49780 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:19:24.099 7fa514b49780 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/12/2025 02:19:24.099 7fa514b49780 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/12/2025 02:19:24.099 7fa514b49780 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:24.100 7fa514b49780 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:19:24.100 7fa514b49780 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:24.100 7fa514b49780 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:24.100 7fa514b49780 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1747016292043676 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/12/2025 02:19:24.100 7fa514b49780 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:28.099 7fa5170164e0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/12/2025 02:19:28.100 7fa5170164e0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 05/12/2025 02:19:28.100 7fa5170164e0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/12/2025 02:19:28.100 7fa5170164e0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:19:28.101 7fa5170164e0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/12/2025 02:19:28.101 7fa5170164e0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:19:28.101 7fa5170164e0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/12/2025 02:19:28.101 7fa5170164e0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/12/2025 02:19:28.101 7fa5170164e0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:28.101 7fa5170164e0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:19:28.101 7fa5170164e0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:28.101 7fa5170164e0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:28.101 7fa5170164e0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1747016292043676 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/12/2025 02:19:28.101 7fa5170164e0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:32.103 7fa5170164e0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/12/2025 02:19:32.104 7fa5170164e0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 05/12/2025 02:19:32.105 7fa5170164e0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/12/2025 02:19:32.105 7fa5170164e0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:19:32.105 7fa5170164e0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/12/2025 02:19:32.105 7fa5170164e0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:19:32.105 7fa5170164e0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/12/2025 02:19:32.106 7fa5170164e0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/12/2025 02:19:32.106 7fa5170164e0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:32.106 7fa5170164e0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:19:32.106 7fa5170164e0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:32.106 7fa5170164e0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:32.106 7fa5170164e0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1747016292043676 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/12/2025 02:19:32.106 7fa5170164e0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:36.107 7fa5170164e0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/12/2025 02:19:36.108 7fa5170164e0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 05/12/2025 02:19:36.108 7fa5170164e0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/12/2025 02:19:36.108 7fa5170164e0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:19:36.109 7fa5170164e0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/12/2025 02:19:36.109 7fa5170164e0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:19:36.109 7fa5170164e0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/12/2025 02:19:36.109 7fa5170164e0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/12/2025 02:19:36.109 7fa5170164e0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:36.109 7fa5170164e0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:19:36.109 7fa5170164e0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:36.109 7fa5170164e0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:36.109 7fa5170164e0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1747016292043676 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/12/2025 02:19:36.109 7fa5170164e0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:40.111 7fa5170164e0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/12/2025 02:19:40.112 7fa5170164e0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 05/12/2025 02:19:40.113 7fa5170164e0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/12/2025 02:19:40.113 7fa5170164e0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:19:40.113 7fa5170164e0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/12/2025 02:19:40.113 7fa5170164e0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:19:40.113 7fa5170164e0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/12/2025 02:19:40.113 7fa5170164e0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/12/2025 02:19:40.113 7fa5170164e0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:40.113 7fa5170164e0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:19:40.113 7fa5170164e0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:40.114 7fa5170164e0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:40.114 7fa5170164e0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1747016292043676 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/12/2025 02:19:40.114 7fa5170164e0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:44.116 7fa514afe828 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/12/2025 02:19:44.117 7fa514afe828 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 05/12/2025 02:19:44.117 7fa514afe828 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/12/2025 02:19:44.117 7fa514afe828 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:19:44.118 7fa514afe828 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/12/2025 02:19:44.118 7fa514afe828 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:19:44.118 7fa514afe828 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/12/2025 02:19:44.118 7fa514afe828 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/12/2025 02:19:44.118 7fa514afe828 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:44.118 7fa514afe828 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:19:44.118 7fa514afe828 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:44.118 7fa514afe828 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:44.118 7fa514afe828 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1747016292043676 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/12/2025 02:19:44.118 7fa514afe828 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:48.120 7fa514afe828 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/12/2025 02:19:48.121 7fa514afe828 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 05/12/2025 02:19:48.121 7fa514afe828 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/12/2025 02:19:48.122 7fa514afe828 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:19:48.122 7fa514afe828 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/12/2025 02:19:48.122 7fa514afe828 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:19:48.122 7fa514afe828 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/12/2025 02:19:48.122 7fa514afe828 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/12/2025 02:19:48.123 7fa514afe828 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:48.123 7fa514afe828 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:19:48.123 7fa514afe828 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:48.123 7fa514afe828 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:48.123 7fa514afe828 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1747016292043676 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/12/2025 02:19:48.123 7fa514afe828 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:52.122 7fa515e772e8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/12/2025 02:19:52.123 7fa515e772e8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 05/12/2025 02:19:52.123 7fa515e772e8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/12/2025 02:19:52.124 7fa515e772e8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:19:52.124 7fa515e772e8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/12/2025 02:19:52.124 7fa515e772e8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:19:52.124 7fa515e772e8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/12/2025 02:19:52.124 7fa515e772e8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/12/2025 02:19:52.124 7fa515e772e8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:52.124 7fa515e772e8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:19:52.124 7fa515e772e8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:52.125 7fa515e772e8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:52.125 7fa515e772e8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1747016292043676 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/12/2025 02:19:52.125 7fa515e772e8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:56.126 7fa515e772e8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/12/2025 02:19:56.127 7fa515e772e8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 05/12/2025 02:19:56.128 7fa515e772e8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/12/2025 02:19:56.128 7fa515e772e8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:19:56.128 7fa515e772e8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/12/2025 02:19:56.128 7fa515e772e8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:19:56.128 7fa515e772e8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/12/2025 02:19:56.128 7fa515e772e8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/12/2025 02:19:56.128 7fa515e772e8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:56.129 7fa515e772e8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:19:56.129 7fa515e772e8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:56.129 7fa515e772e8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:19:56.129 7fa515e772e8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1747016292043676 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/12/2025 02:19:56.129 7fa515e772e8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:20:00.131 7fa515e772e8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/12/2025 02:20:00.132 7fa515e772e8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 05/12/2025 02:20:00.132 7fa515e772e8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/12/2025 02:20:00.132 7fa515e772e8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:20:00.133 7fa515e772e8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/12/2025 02:20:00.133 7fa515e772e8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:20:00.133 7fa515e772e8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/12/2025 02:20:00.133 7fa515e772e8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/12/2025 02:20:00.133 7fa515e772e8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:20:00.133 7fa515e772e8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:20:00.133 7fa515e772e8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:20:00.133 7fa515e772e8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:20:00.133 7fa515e772e8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1747016292043676 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/12/2025 02:20:00.134 7fa515e772e8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:20:04.135 7fa515e772e8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/12/2025 02:20:04.136 7fa515e772e8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 05/12/2025 02:20:04.136 7fa515e772e8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/12/2025 02:20:04.136 7fa515e772e8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:20:04.137 7fa515e772e8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/12/2025 02:20:04.137 7fa515e772e8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:20:04.137 7fa515e772e8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/12/2025 02:20:04.137 7fa515e772e8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/12/2025 02:20:04.137 7fa515e772e8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:20:04.137 7fa515e772e8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:20:04.137 7fa515e772e8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:20:04.137 7fa515e772e8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:20:04.138 7fa515e772e8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1747016292043676 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/12/2025 02:20:04.138 7fa515e772e8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:20:08.137 7fa515e772e8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/12/2025 02:20:08.139 7fa515e772e8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 05/12/2025 02:20:08.139 7fa515e772e8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/12/2025 02:20:08.139 7fa515e772e8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:20:08.139 7fa515e772e8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/12/2025 02:20:08.139 7fa515e772e8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:20:08.139 7fa515e772e8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 05/12/2025 02:20:08.140 7fa515e772e8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 05/12/2025 02:20:08.140 7fa515e772e8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:20:08.140 7fa515e772e8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 05/12/2025 02:20:08.140 7fa515e772e8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:20:08.140 7fa515e772e8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:20:08.140 7fa515e772e8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1747016292043676 collector_name = collector_ip = 10.0.0.130:8086 collector_list = [ 10.0.0.130:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 05/12/2025 02:20:08.140 7fa515e772e8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/12/2025 02:20:12.143 7fa515e772e8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/12/2025 02:20:12.145 7fa515e772e8 [contrail-schema] [INFO]: Session Event: TCP Connected 05/12/2025 02:20:12.145 7fa515e772e8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/12/2025 02:20:12.145 7fa515e772e8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:20:12.145 7fa515e772e8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3299-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.130:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.130:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.130:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.130:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.130:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/12/2025 02:20:12.146 7fa515e772e8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/12/2025 02:20:12.146 7fa515e772e8 [contrail-schema] [INFO]: Processing event[EvTcpConnected] in state[Connect] 05/12/2025 02:20:12.146 7fa515e772e8 [contrail-schema] [DEBUG]: Send sandesh control message. uve type count # 19 05/12/2025 02:20:12.146 7fa515e772e8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 05/12/2025 02:20:12.146 7fa515e772e8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 05/12/2025 02:20:12.146 7fa515e772e8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 05/12/2025 02:20:12.147 7fa514b26630 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 05/12/2025 02:20:12.148 7fa514b26630 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 05/12/2025 02:20:18.659 7fa514b268d0 [contrail-schema] [DEBUG]: Extracted sandesh length: 0000001016 05/12/2025 02:20:18.660 7fa514b268d0 [contrail-schema] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 05/12/2025 02:20:18.661 7fa514b49588 [contrail-schema] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 05/12/2025 02:20:18.661 7fa514b49588 [contrail-schema] [DEBUG]: Number of uve types in sandesh control message is 0 05/12/2025 02:20:18.661 7fa514b49588 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 05/12/2025 02:20:18.661 7fa514b49588 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 05/12/2025 02:20:18.661 7fa514b49588 [contrail-schema] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 05/12/2025 02:20:18.662 7fa515e772e8 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 05/12/2025 02:20:18.663 7fa515e772e8 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 05/12/2025 02:20:28.634 7fa514b268d0 [contrail-schema] [DEBUG]: Extracted sandesh length: 0000001296 05/12/2025 02:20:28.635 7fa514b268d0 [contrail-schema] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 05/12/2025 02:20:28.635 7fa514b54240 [contrail-schema] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 05/12/2025 02:20:28.635 7fa514b54240 [contrail-schema] [DEBUG]: Number of uve types in sandesh control message is 2 05/12/2025 02:20:28.635 7fa514b54240 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 05/12/2025 02:20:28.635 7fa514b54240 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 05/12/2025 02:22:12.350 7fa514b4b438 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 05/12/2025 02:22:14.465 7fa514b4b438 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 05/12/2025 02:23:08.614 7fa514acdb70 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 05/12/2025 02:32:48.418 7fa514b18240 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 05/12/2025 02:33:29.226 7fa514b18240 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map