09/01/2025 01:56:08.442 7fd141745a80 [contrail-schema] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 09/01/2025 01:56:08.442 7fd141745a80 [contrail-schema] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 09/01/2025 01:56:08.442 7fd141745a80 [contrail-schema] [INFO]: SANDESH: Flow Logging: [None] -> [False] 09/01/2025 01:56:08.442 7fd13f33ea40 [contrail-schema] [INFO]: Processing event[EvStart] in state[none] 09/01/2025 01:56:08.442 7fd13f33ea40 [contrail-schema] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 01:56:08.443 7fd13f33ea40 [contrail-schema] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 09/01/2025 01:56:08.443 7fd13f33ea40 [contrail-schema] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 09/01/2025 01:56:08.443 7fd13f33ea40 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:08.443 7fd13f33ea40 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/01/2025 01:56:08.443 7fd13f33ea40 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:08.443 7fd13f33ea40 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:08.443 7fd13f33ea40 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1756691768443132 collector_name = collector_ip = collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 09/01/2025 01:56:08.443 7fd13f33ea40 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:08.493 7fd141745a80 [contrail-schema] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.254:5673//'] 09/01/2025 01:56:08.500 7fd141745a80 [contrail-schema] [WARNING]: RabbitMQ drainer connection down 09/01/2025 01:56:08.500 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:08.501 7fd13edff7c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 09/01/2025 01:56:08.501 7fd13edff7c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:08.501 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:08.501 7fd13edff7c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 09/01/2025 01:56:08.501 7fd13edff7c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:08.504 7fd141745a80 [contrail-schema] [WARNING]: RabbitMQ drainer connection ESTABLISHED 09/01/2025 01:56:08.504 7fd13edff720 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:08.504 7fd13edff720 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/01/2025 01:56:08.504 7fd13edff720 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:08.513 7fd141745a80 [contrail-schema] [WARNING]: RabbitMQ publish connection down 09/01/2025 01:56:08.513 7fd13ee50400 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:08.514 7fd13ee50400 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 09/01/2025 01:56:08.514 7fd13ee50400 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:08.516 7fd141745a80 [contrail-schema] [WARNING]: RabbitMQ publish connection ESTABLISHED 09/01/2025 01:56:08.516 7fd13ee50400 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:08.516 7fd13ee50400 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/01/2025 01:56:08.516 7fd13ee50400 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:08.547 7fd141745a80 [contrail-schema] [DEBUG]: Removed remained AMQP queue 09/01/2025 01:56:08.548 7fd13ee50860 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:08.548 7fd13ee50860 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Zookeeper:Zookeeper[] connection down >>, ] >> 09/01/2025 01:56:08.548 7fd13ee50860 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:08.573 7fd141745a80 [contrail-schema] [WARNING]: Waiting to be elected as master... 09/01/2025 01:56:08.576 7fd13ee50860 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:08.576 7fd13ee50860 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/01/2025 01:56:08.576 7fd13ee50860 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:08.612 7fd141745a80 [contrail-schema] [WARNING]: Elected master Schema Transformer node. Initializing... 09/01/2025 01:56:08.612 7fd141745a80 [contrail-schema] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8087 09/01/2025 01:56:08.614 7fd141745a80 [contrail-schema] [DEBUG]: Add [config_updater.xml:/usr/local/lib/python3.9/site-packages/cfgm_common/uve/config_updater] to home page 09/01/2025 01:56:08.614 7fd141745a80 [contrail-schema] [DEBUG]: Add http request [/Snh_ConfigApiUpdateReq] 09/01/2025 01:56:08.615 7fd141745a80 [contrail-schema] [DEBUG]: Add [greenlets.xml:/usr/local/lib/python3.9/site-packages/cfgm_common/uve/greenlets] to home page 09/01/2025 01:56:08.615 7fd141745a80 [contrail-schema] [DEBUG]: Add http request [/Snh_GreenletObjectReq] 09/01/2025 01:56:08.616 7fd141745a80 [contrail-schema] [DEBUG]: Add [cpuinfo.xml:/usr/local/lib/python3.9/site-packages/cfgm_common/uve/nodeinfo/cpuinfo] to home page 09/01/2025 01:56:08.616 7fd141745a80 [contrail-schema] [DEBUG]: Add http request [/Snh_CpuLoadInfoReq] 09/01/2025 01:56:08.619 7fd141745a80 [contrail-schema] [DEBUG]: Add [st_introspect.xml:/usr/local/lib/python3.9/site-packages/schema_transformer/sandesh/st_introspect] to home page 09/01/2025 01:56:08.619 7fd141745a80 [contrail-schema] [DEBUG]: Add http request [/Snh_VnList] 09/01/2025 01:56:08.619 7fd141745a80 [contrail-schema] [DEBUG]: Add http request [/Snh_RoutingInstanceList] 09/01/2025 01:56:08.620 7fd141745a80 [contrail-schema] [DEBUG]: Add http request [/Snh_ServiceChainList] 09/01/2025 01:56:08.620 7fd141745a80 [contrail-schema] [DEBUG]: Add http request [/Snh_StObjectReq] 09/01/2025 01:56:08.621 7fd141745a80 [contrail-schema] [DEBUG]: Add [sandesh_alarm.xml:/usr/local/lib/python3.9/site-packages/pysandesh/gen_py/sandesh_alarm] to home page 09/01/2025 01:56:08.621 7fd141745a80 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshAlarmCacheRequest] 09/01/2025 01:56:08.621 7fd141745a80 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshAlarmTypesRequest] 09/01/2025 01:56:08.621 7fd141745a80 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshAlarmAckRequest] 09/01/2025 01:56:08.622 7fd141745a80 [contrail-schema] [DEBUG]: Add [sandesh_ctrl.xml:/usr/local/lib/python3.9/site-packages/pysandesh/gen_py/sandesh_ctrl] to home page 09/01/2025 01:56:08.622 7fd141745a80 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshCtrlClientToServer] 09/01/2025 01:56:08.622 7fd141745a80 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshCtrlServerToClient] 09/01/2025 01:56:08.622 7fd141745a80 [contrail-schema] [DEBUG]: Add [sandesh_trace.xml:/usr/local/lib/python3.9/site-packages/pysandesh/gen_py/sandesh_trace] to home page 09/01/2025 01:56:08.622 7fd141745a80 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshTraceRequest] 09/01/2025 01:56:08.623 7fd141745a80 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshTraceBufferListRequest] 09/01/2025 01:56:08.623 7fd141745a80 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshTraceEnableDisableReq] 09/01/2025 01:56:08.623 7fd141745a80 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshTraceBufStatusReq] 09/01/2025 01:56:08.623 7fd141745a80 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshTraceBufferEnableDisableReq] 09/01/2025 01:56:08.624 7fd141745a80 [contrail-schema] [DEBUG]: Add [sandesh_uve.xml:/usr/local/lib/python3.9/site-packages/pysandesh/gen_py/sandesh_uve] to home page 09/01/2025 01:56:08.624 7fd141745a80 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshMessageStatsReq] 09/01/2025 01:56:08.624 7fd141745a80 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsSet] 09/01/2025 01:56:08.624 7fd141745a80 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsStatus] 09/01/2025 01:56:08.624 7fd141745a80 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshSendingParamsSet] 09/01/2025 01:56:08.624 7fd141745a80 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshSendingParamsStatus] 09/01/2025 01:56:08.624 7fd141745a80 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsSet] 09/01/2025 01:56:08.624 7fd141745a80 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsReset] 09/01/2025 01:56:08.624 7fd141745a80 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsStatus] 09/01/2025 01:56:08.624 7fd141745a80 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshSendQueueSet] 09/01/2025 01:56:08.624 7fd141745a80 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshSendQueueStatus] 09/01/2025 01:56:08.624 7fd141745a80 [contrail-schema] [DEBUG]: Add http request [/Snh_CollectorInfoRequest] 09/01/2025 01:56:08.624 7fd141745a80 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshUVEDSConfReq] 09/01/2025 01:56:08.625 7fd141745a80 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshUVECacheReq] 09/01/2025 01:56:08.625 7fd141745a80 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshUVETypesReq] 09/01/2025 01:56:08.632 7fd13edffea0 [contrail-schema] [ERROR]: Cannot write http_port 8087 to /tmp/contrail-schema.0.http_port 09/01/2025 01:56:08.632 7fd13edffea0 [contrail-schema] [ERROR]: Starting Introspect on HTTP Port 8087 09/01/2025 01:56:08.632 7fd13f415860 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:08.632 7fd13f415860 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Initializing description = ApiServer >>, ] description = Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[ApiServer] connection down >>, ] >> 09/01/2025 01:56:08.632 7fd13f415860 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:08.634 7fd13f415a40 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:08.634 7fd13f415a40 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Down description = ApiServer >>, ] description = Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[ApiServer] connection down >>, ] >> 09/01/2025 01:56:08.634 7fd13f415a40 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:12.444 7fd13f415b80 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:12.446 7fd13f415b80 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:12.446 7fd13f415b80 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:12.446 7fd13f415b80 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:12.446 7fd13f415b80 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Down description = ApiServer >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer] connection down >>, ] >> 09/01/2025 01:56:12.446 7fd13f415b80 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:12.447 7fd13f415b80 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:12.447 7fd13f415b80 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:12.447 7fd13f415b80 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:12.447 7fd13f415b80 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Down description = ApiServer >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer] connection down >>, ] >> 09/01/2025 01:56:12.447 7fd13f415b80 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:12.447 7fd13f415b80 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:12.448 7fd13f415b80 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:56:12.448 7fd13f415b80 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:16.447 7fd13f415900 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:16.448 7fd13f415900 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:16.448 7fd13f415900 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:16.448 7fd13f415900 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:16.448 7fd13f415900 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Down description = ApiServer >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer] connection down >>, ] >> 09/01/2025 01:56:16.448 7fd13f415900 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:16.448 7fd13f415900 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:16.449 7fd13f415900 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:16.449 7fd13f415900 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:16.449 7fd13f415900 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Down description = ApiServer >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer] connection down >>, ] >> 09/01/2025 01:56:16.449 7fd13f415900 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:16.449 7fd13f415900 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:16.449 7fd13f415900 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:56:16.452 7fd13f415900 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:17.681 7fd141745a80 [contrail-schema] [WARNING]: VNCCassandra started with driver cql 09/01/2025 01:56:17.681 7fd141745a80 [contrail-schema] [WARNING]: initializing cassandra cluster 09/01/2025 01:56:17.681 7fd141745a80 [contrail-schema] [WARNING]: CassandraDriverCQL.__init__Cluster before create 09/01/2025 01:56:17.682 7fd13f415b80 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:17.682 7fd13f415b80 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:17.682 7fd13f415b80 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:17.682 7fd13f415b80 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:17.682 7fd13f415b80 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 09/01/2025 01:56:17.683 7fd13f415b80 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:17.685 7fd141745a80 [contrail-schema] [WARNING]: CassandraDriverCQL.__init__Cluster created 09/01/2025 01:56:17.737 7fd141745a80 [contrail-schema] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 09/01/2025 01:56:17.740 7fd13ef05180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:17.740 7fd13ef05180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Initializing description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Zookeeper:Zookeeper[], Database:Cassandra[] connection down >>, ] >> 09/01/2025 01:56:17.740 7fd13ef05180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:17.747 7fd141745a80 [contrail-schema] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 09/01/2025 01:56:17.748 7fd13ef05180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:17.748 7fd13ef05180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 09/01/2025 01:56:17.748 7fd13ef05180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:17.762 7fd141745a80 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/01/2025 01:56:17.836 7fd141745a80 [contrail-schema] [WARNING]: keyspace 'to_bgp_keyspace', created 09/01/2025 01:56:17.842 7fd141745a80 [contrail-schema] [WARNING]: Zookeeper lock released. 09/01/2025 01:56:17.860 7fd141745a80 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/01/2025 01:56:17.950 7fd141745a80 [contrail-schema] [WARNING]: keyspace 'to_bgp_keyspace' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None} 09/01/2025 01:56:17.957 7fd141745a80 [contrail-schema] [WARNING]: Zookeeper lock released. 09/01/2025 01:56:17.957 7fd141745a80 [contrail-schema] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 09/01/2025 01:56:17.995 7fd141745a80 [contrail-schema] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 09/01/2025 01:56:18.057 7fd141745a80 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/01/2025 01:56:18.254 7fd141745a80 [contrail-schema] [WARNING]: table 'route_target_table', created 09/01/2025 01:56:18.268 7fd141745a80 [contrail-schema] [WARNING]: Zookeeper lock released. 09/01/2025 01:56:18.361 7fd141745a80 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/01/2025 01:56:18.482 7fd141745a80 [contrail-schema] [WARNING]: table 'route_target_table' fixed with properties {'gc_grace_seconds': 864000} 09/01/2025 01:56:18.486 7fd141745a80 [contrail-schema] [WARNING]: Zookeeper lock released. 09/01/2025 01:56:18.694 7fd141745a80 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/01/2025 01:56:18.866 7fd141745a80 [contrail-schema] [WARNING]: table 'service_chain_ip_address_table', created 09/01/2025 01:56:18.874 7fd141745a80 [contrail-schema] [WARNING]: Zookeeper lock released. 09/01/2025 01:56:18.986 7fd141745a80 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/01/2025 01:56:19.228 7fd141745a80 [contrail-schema] [WARNING]: table 'service_chain_ip_address_table' fixed with properties {'gc_grace_seconds': 864000} 09/01/2025 01:56:19.236 7fd141745a80 [contrail-schema] [WARNING]: Zookeeper lock released. 09/01/2025 01:56:19.466 7fd141745a80 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/01/2025 01:56:19.697 7fd141745a80 [contrail-schema] [WARNING]: table 'service_chain_table', created 09/01/2025 01:56:19.703 7fd141745a80 [contrail-schema] [WARNING]: Zookeeper lock released. 09/01/2025 01:56:19.841 7fd141745a80 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/01/2025 01:56:19.963 7fd141745a80 [contrail-schema] [WARNING]: table 'service_chain_table' fixed with properties {'gc_grace_seconds': 864000} 09/01/2025 01:56:19.968 7fd141745a80 [contrail-schema] [WARNING]: Zookeeper lock released. 09/01/2025 01:56:20.138 7fd141745a80 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/01/2025 01:56:20.347 7fd141745a80 [contrail-schema] [WARNING]: table 'service_chain_uuid_table', created 09/01/2025 01:56:20.360 7fd141745a80 [contrail-schema] [WARNING]: Zookeeper lock released. 09/01/2025 01:56:20.448 7fd13edd9860 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:20.450 7fd13edd9860 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:20.450 7fd13edd9860 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:20.450 7fd13edd9860 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:20.450 7fd13edd9860 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 09/01/2025 01:56:20.450 7fd13edd9860 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:20.450 7fd13edd9860 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:20.451 7fd13edd9860 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:20.451 7fd13edd9860 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:20.451 7fd13edd9860 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 09/01/2025 01:56:20.451 7fd13edd9860 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:20.451 7fd13edd9860 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:20.451 7fd13edd9860 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/01/2025 01:56:20.451 7fd13edd9860 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:20.518 7fd141745a80 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 09/01/2025 01:56:20.635 7fd141745a80 [contrail-schema] [WARNING]: table 'service_chain_uuid_table' fixed with properties {'gc_grace_seconds': 864000} 09/01/2025 01:56:20.641 7fd141745a80 [contrail-schema] [WARNING]: Zookeeper lock released. 09/01/2025 01:56:20.642 7fd13f415d60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:20.642 7fd13f415d60 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:20.642 7fd13f415d60 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:20.670 7fd141745a80 [contrail-schema] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.254:5673//'] 09/01/2025 01:56:20.671 7fd141745a80 [contrail-schema] [WARNING]: RabbitMQ drainer connection down 09/01/2025 01:56:20.672 7fd13f415860 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:20.672 7fd13f415860 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 09/01/2025 01:56:20.672 7fd13f415860 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:20.672 7fd13f415860 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:20.673 7fd13f415860 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Down description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 09/01/2025 01:56:20.673 7fd13f415860 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:20.677 7fd141745a80 [contrail-schema] [WARNING]: RabbitMQ drainer connection ESTABLISHED 09/01/2025 01:56:20.677 7fd13f415860 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:20.678 7fd13f415860 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:20.678 7fd13f415860 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:20.684 7fd141745a80 [contrail-schema] [WARNING]: RabbitMQ publish connection down 09/01/2025 01:56:20.687 7fd13f415860 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:20.688 7fd13f415860 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Down description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 09/01/2025 01:56:20.688 7fd13f415860 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:20.692 7fd141745a80 [contrail-schema] [WARNING]: RabbitMQ publish connection ESTABLISHED 09/01/2025 01:56:20.693 7fd13f415860 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:20.693 7fd13f415860 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:20.694 7fd13f415860 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:20.694 7fd13f415860 [contrail-schema] [WARNING]: RabbitMQ publish connection down 09/01/2025 01:56:20.696 7fd13edd9ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:20.698 7fd13edd9ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Down description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 09/01/2025 01:56:20.698 7fd13edd9ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:20.705 7fd13f415860 [contrail-schema] [WARNING]: RabbitMQ publish connection ESTABLISHED 09/01/2025 01:56:20.705 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:20.705 7fd13edff7c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:20.705 7fd13edff7c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:21.094 7fd141745a80 [contrail-schema] [INFO]: GlobalSystemConfigST - REINIT Start 09/01/2025 01:56:21.098 7fd141745a80 [contrail-schema] [INFO]: GlobalSystemConfigST - REINIT Complete 09/01/2025 01:56:21.098 7fd141745a80 [contrail-schema] [INFO]: PhysicalRouterST - REINIT Start 09/01/2025 01:56:21.099 7fd141745a80 [contrail-schema] [INFO]: PhysicalRouterST - REINIT Complete 09/01/2025 01:56:21.099 7fd141745a80 [contrail-schema] [INFO]: BgpRouterST - REINIT Start 09/01/2025 01:56:21.100 7fd141745a80 [contrail-schema] [INFO]: BgpRouterST - REINIT Complete 09/01/2025 01:56:21.101 7fd141745a80 [contrail-schema] [INFO]: BgpvpnST - REINIT Start 09/01/2025 01:56:21.102 7fd141745a80 [contrail-schema] [INFO]: BgpvpnST - REINIT Complete 09/01/2025 01:56:21.102 7fd141745a80 [contrail-schema] [INFO]: LogicalRouterST - REINIT Start 09/01/2025 01:56:21.103 7fd141745a80 [contrail-schema] [INFO]: LogicalRouterST - REINIT Complete 09/01/2025 01:56:21.819 7fd141745a80 [contrail-schema] [INFO]: RouteTargetST - REINIT Start 09/01/2025 01:56:21.827 7fd141745a80 [contrail-schema] [INFO]: RouteTargetST - REINIT Complete 09/01/2025 01:56:21.827 7fd141745a80 [contrail-schema] [DEBUG]: VirtualNetworkST - REINIT Start 09/01/2025 01:56:21.827 7fd141745a80 [contrail-schema] [DEBUG]: VirtualNetworkST - REINIT Complete 09/01/2025 01:56:21.827 7fd141745a80 [contrail-schema] [DEBUG]: VirtualNetworkST - REINIT Start 09/01/2025 01:56:21.827 7fd141745a80 [contrail-schema] [DEBUG]: VirtualNetworkST - REINIT Complete 09/01/2025 01:56:21.827 7fd141745a80 [contrail-schema] [DEBUG]: VirtualNetworkST - REINIT Start 09/01/2025 01:56:21.828 7fd141745a80 [contrail-schema] [DEBUG]: VirtualNetworkST - REINIT Complete 09/01/2025 01:56:21.828 7fd141745a80 [contrail-schema] [DEBUG]: VirtualNetworkST - REINIT Start 09/01/2025 01:56:21.828 7fd141745a80 [contrail-schema] [DEBUG]: VirtualNetworkST - REINIT Complete 09/01/2025 01:56:21.828 7fd141745a80 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Start 09/01/2025 01:56:21.828 7fd141745a80 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Complete 09/01/2025 01:56:21.828 7fd141745a80 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Start 09/01/2025 01:56:21.962 7fd141745a80 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Complete 09/01/2025 01:56:21.962 7fd141745a80 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Start 09/01/2025 01:56:22.106 7fd141745a80 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Complete 09/01/2025 01:56:22.106 7fd141745a80 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Start 09/01/2025 01:56:22.250 7fd141745a80 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Complete 09/01/2025 01:56:22.250 7fd141745a80 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Start 09/01/2025 01:56:22.251 7fd141745a80 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Complete 09/01/2025 01:56:22.251 7fd141745a80 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Start 09/01/2025 01:56:22.418 7fd141745a80 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Complete 09/01/2025 01:56:22.418 7fd141745a80 [contrail-schema] [INFO]: NetworkPolicyST - REINIT Start 09/01/2025 01:56:22.421 7fd141745a80 [contrail-schema] [INFO]: NetworkPolicyST - REINIT Complete 09/01/2025 01:56:22.422 7fd141745a80 [contrail-schema] [INFO]: VirtualMachineInterfaceST - REINIT Start 09/01/2025 01:56:22.424 7fd141745a80 [contrail-schema] [INFO]: VirtualMachineInterfaceST - REINIT Complete 09/01/2025 01:56:22.425 7fd141745a80 [contrail-schema] [INFO]: VirtualPortGroupST - REINIT Start 09/01/2025 01:56:22.427 7fd141745a80 [contrail-schema] [INFO]: VirtualPortGroupST - REINIT Complete 09/01/2025 01:56:22.428 7fd141745a80 [contrail-schema] [INFO]: InstanceIpST - REINIT Start 09/01/2025 01:56:22.430 7fd141745a80 [contrail-schema] [INFO]: InstanceIpST - REINIT Complete 09/01/2025 01:56:22.431 7fd141745a80 [contrail-schema] [INFO]: FloatingIpST - REINIT Start 09/01/2025 01:56:22.432 7fd141745a80 [contrail-schema] [INFO]: FloatingIpST - REINIT Complete 09/01/2025 01:56:22.433 7fd141745a80 [contrail-schema] [INFO]: AliasIpST - REINIT Start 09/01/2025 01:56:22.434 7fd141745a80 [contrail-schema] [INFO]: AliasIpST - REINIT Complete 09/01/2025 01:56:22.435 7fd141745a80 [contrail-schema] [INFO]: RoutingPolicyST - REINIT Start 09/01/2025 01:56:22.436 7fd141745a80 [contrail-schema] [INFO]: RoutingPolicyST - REINIT Complete 09/01/2025 01:56:22.438 7fd141745a80 [contrail-schema] [INFO]: RouteAggregateST - REINIT Start 09/01/2025 01:56:22.439 7fd141745a80 [contrail-schema] [INFO]: RouteAggregateST - REINIT Complete 09/01/2025 01:56:22.440 7fd141745a80 [contrail-schema] [INFO]: PortTupleST - REINIT Start 09/01/2025 01:56:22.442 7fd141745a80 [contrail-schema] [INFO]: PortTupleST - REINIT Complete 09/01/2025 01:56:22.442 7fd141745a80 [contrail-schema] [INFO]: BgpAsAServiceST - REINIT Start 09/01/2025 01:56:22.443 7fd141745a80 [contrail-schema] [INFO]: BgpAsAServiceST - REINIT Complete 09/01/2025 01:56:22.443 7fd141745a80 [contrail-schema] [INFO]: RouteTableST - REINIT Start 09/01/2025 01:56:22.444 7fd141745a80 [contrail-schema] [INFO]: RouteTableST - REINIT Complete 09/01/2025 01:56:22.445 7fd141745a80 [contrail-schema] [DEBUG]: Add uve in the [ObjectVNTable:UveVirtualNetworkConfigTrace] map 09/01/2025 01:56:22.445 7fd141745a80 [contrail-schema] [WARNING]: Virtual-Network Evaluate Complete: VN Name (default-domain:default-project:__link_local__): Duration (0.001) sec 09/01/2025 01:56:22.445 7fd141745a80 [contrail-schema] [DEBUG]: Add uve in the [ObjectVNTable:UveVirtualNetworkConfigTrace] map 09/01/2025 01:56:22.445 7fd141745a80 [contrail-schema] [WARNING]: Virtual-Network Evaluate Complete: VN Name (default-domain:default-project:dci-network): Duration (0.000) sec 09/01/2025 01:56:22.446 7fd141745a80 [contrail-schema] [DEBUG]: Add uve in the [ObjectVNTable:UveVirtualNetworkConfigTrace] map 09/01/2025 01:56:22.446 7fd141745a80 [contrail-schema] [WARNING]: Virtual-Network Evaluate Complete: VN Name (default-domain:default-project:default-virtual-network): Duration (0.000) sec 09/01/2025 01:56:22.447 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:22.447 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] UveVirtualNetworkConfigTrace: data = << name = default-domain:default-project:__link_local__ connected_networks = [ ] partially_connected_networks = [ ] routing_instance_list = [ default-domain:default-project:__link_local__:__link_local__, ] total_acl_rules = 0 >> 09/01/2025 01:56:22.447 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:22.448 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:22.448 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] UveVirtualNetworkConfigTrace: data = << name = default-domain:default-project:dci-network connected_networks = [ ] partially_connected_networks = [ ] routing_instance_list = [ default-domain:default-project:dci-network:dci-network, default-domain:default-project:dci-network:__default__, ] total_acl_rules = 0 >> 09/01/2025 01:56:22.448 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:22.448 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:22.448 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] UveVirtualNetworkConfigTrace: data = << name = default-domain:default-project:default-virtual-network connected_networks = [ ] partially_connected_networks = [ ] routing_instance_list = [ default-domain:default-project:default-virtual-network:default-virtual-network, ] total_acl_rules = 0 >> 09/01/2025 01:56:22.448 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:22.630 7fd141745a80 [contrail-schema] [DEBUG]: Add uve in the [ObjectVNTable:UveVirtualNetworkConfigTrace] map 09/01/2025 01:56:22.631 7fd141745a80 [contrail-schema] [WARNING]: Virtual-Network Evaluate Complete: VN Name (default-domain:default-project:ip-fabric): Duration (0.185) sec 09/01/2025 01:56:22.631 7fd141745a80 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Start 09/01/2025 01:56:22.632 7fd141745a80 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Complete 09/01/2025 01:56:22.632 7fd141745a80 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Start 09/01/2025 01:56:22.632 7fd141745a80 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Complete 09/01/2025 01:56:22.632 7fd141745a80 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Start 09/01/2025 01:56:22.632 7fd141745a80 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Complete 09/01/2025 01:56:22.632 7fd141745a80 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Start 09/01/2025 01:56:22.633 7fd141745a80 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Complete 09/01/2025 01:56:22.633 7fd141745a80 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Start 09/01/2025 01:56:22.633 7fd141745a80 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Complete 09/01/2025 01:56:22.633 7fd141745a80 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Start 09/01/2025 01:56:22.633 7fd141745a80 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Complete 09/01/2025 01:56:22.634 7fd141745a80 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Start 09/01/2025 01:56:22.634 7fd141745a80 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Complete 09/01/2025 01:56:22.634 7fd141745a80 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Start 09/01/2025 01:56:22.634 7fd141745a80 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Complete 09/01/2025 01:56:22.635 7fd141745a80 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Start 09/01/2025 01:56:22.635 7fd141745a80 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Complete 09/01/2025 01:56:22.635 7fd141745a80 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Start 09/01/2025 01:56:22.635 7fd141745a80 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Complete 09/01/2025 01:56:22.635 7fd141745a80 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Start 09/01/2025 01:56:22.635 7fd141745a80 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Complete 09/01/2025 01:56:22.636 7fd141745a80 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Start 09/01/2025 01:56:22.639 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:22.640 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] UveVirtualNetworkConfigTrace: data = << name = default-domain:default-project:ip-fabric connected_networks = [ ] partially_connected_networks = [ ] routing_instance_list = [ default-domain:default-project:ip-fabric:__default__, default-domain:default-project:ip-fabric:ip-fabric, ] total_acl_rules = 3 >> 09/01/2025 01:56:22.640 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:22.778 7fd141745a80 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Complete 09/01/2025 01:56:22.780 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'ingress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [], 'dynamic': None}, 'display_name': 'ingress-access-control-list', 'fq_name': ['default-domain', 'default-project', '__no_rule__', 'ingress-access-control-list'], 'id_perms': {'created': '2025-09-01T01:56:21.649544', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:56:21.649544', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13203257685329782482, 'uuid_mslong': 2528004923546619689}}, 'parent_type': 'security-group', 'parent_uuid': '9f2015c4-f792-480b-8162-094cf6d6ab73', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '23154715-826f-4f29-b73b-64e9340726d2'}, 'oper': 'CREATE', 'request-id': 'req-46b2d4bd-e723-451b-93e9-bc272888a376', 'type': 'access_control_list', 'uuid': '23154715-826f-4f29-b73b-64e9340726d2'} 09/01/2025 01:56:22.781 7fd13edd9cc0 [contrail-schema] [ERROR]: Error in rabbitmq drainer greenlet: 'SchemaTransformerLogger' object has no attribute 'warn' 09/01/2025 01:56:22.782 7fd13edd9cc0 [contrail-schema] [WARNING]: RabbitMQ drainer connection down 09/01/2025 01:56:22.785 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'egress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [], 'dynamic': None}, 'display_name': 'egress-access-control-list', 'fq_name': ['default-domain', 'default-project', '__no_rule__', 'egress-access-control-list'], 'id_perms': {'created': '2025-09-01T01:56:21.770181', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:56:21.770181', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12720638828644713230, 'uuid_mslong': 13891977981821996092}}, 'parent_type': 'security-group', 'parent_uuid': '9f2015c4-f792-480b-8162-094cf6d6ab73', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c0ca385f-220c-4c3c-b088-c99e2968c30e'}, 'oper': 'CREATE', 'request-id': 'req-e1722877-1380-4bff-950d-5bd6bf5d810b', 'type': 'access_control_list', 'uuid': 'c0ca385f-220c-4c3c-b088-c99e2968c30e'} 09/01/2025 01:56:22.786 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:22.787 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Down description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 09/01/2025 01:56:22.787 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:22.794 7fd13edd9cc0 [contrail-schema] [WARNING]: RabbitMQ drainer connection ESTABLISHED 09/01/2025 01:56:22.795 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:22.795 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:22.795 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:22.804 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'egress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [], 'dynamic': None}, 'display_name': 'egress-access-control-list', 'fq_name': ['default-domain', 'default-project', '__no_rule__', 'egress-access-control-list'], 'id_perms': {'created': '2025-09-01T01:56:21.770181', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:56:21.770181', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12720638828644713230, 'uuid_mslong': 13891977981821996092}}, 'parent_type': 'security-group', 'parent_uuid': '9f2015c4-f792-480b-8162-094cf6d6ab73', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c0ca385f-220c-4c3c-b088-c99e2968c30e'}, 'oper': 'CREATE', 'request-id': 'req-e1722877-1380-4bff-950d-5bd6bf5d810b', 'type': 'access_control_list', 'uuid': 'c0ca385f-220c-4c3c-b088-c99e2968c30e'} 09/01/2025 01:56:22.804 7fd13edd9cc0 [contrail-schema] [ERROR]: Error in rabbitmq drainer greenlet: 'SchemaTransformerLogger' object has no attribute 'warn' 09/01/2025 01:56:22.805 7fd13edd9cc0 [contrail-schema] [WARNING]: RabbitMQ drainer connection down 09/01/2025 01:56:22.807 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['target:64512:8000000'], 'obj_dict': {'display_name': 'target:64512:8000000', 'fq_name': ['target:64512:8000000'], 'id_perms': {'created': '2025-09-01T01:56:21.892449', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:56:21.892449', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9906866012233534808, 'uuid_mslong': 1099819438931527018}}, 'perms2': {'global_access': 0, 'owner': '27b8a85e67fe427d9ebc42e690325176', 'owner_access': 7, 'share': []}, 'uuid': '0f4357f3-de95-456a-897c-422638920d58'}, 'oper': 'CREATE', 'request-id': 'req-8b8dd430-b9f8-4a92-af04-c5f4006ee126', 'type': 'route_target', 'uuid': '0f4357f3-de95-456a-897c-422638920d58'} 09/01/2025 01:56:22.809 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'dci-network', '__default__'], 'oper': 'UPDATE', 'request-id': 'req-9fbf836e-8fdf-4d4e-89b2-4b7bec2c7e50', 'type': 'routing_instance', 'uuid': '3abc5d2d-5e7d-442a-b101-e08c43bc6ef8'} 09/01/2025 01:56:22.811 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['target:64512:8000001'], 'obj_dict': {'display_name': 'target:64512:8000001', 'fq_name': ['target:64512:8000001'], 'id_perms': {'created': '2025-09-01T01:56:21.990808', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:56:21.990808', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10275245882271155766, 'uuid_mslong': 982427147137075297}}, 'perms2': {'global_access': 0, 'owner': '27b8a85e67fe427d9ebc42e690325176', 'owner_access': 7, 'share': []}, 'uuid': '0da24849-02ce-4861-8e99-01b078914636'}, 'oper': 'CREATE', 'request-id': 'req-a900cab5-238e-4f77-8714-a9f66b5200ec', 'type': 'route_target', 'uuid': '0da24849-02ce-4861-8e99-01b078914636'} 09/01/2025 01:56:22.812 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'dci-network', 'dci-network'], 'oper': 'UPDATE', 'request-id': 'req-78a994d8-0626-475d-a558-d2ae3794ed7b', 'type': 'routing_instance', 'uuid': '1ad7f85c-cbfe-4577-90e4-e28e82635f8c'} 09/01/2025 01:56:22.815 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['target:64512:8000002'], 'obj_dict': {'display_name': 'target:64512:8000002', 'fq_name': ['target:64512:8000002'], 'id_perms': {'created': '2025-09-01T01:56:22.131768', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:56:22.131768', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11002289436871653977, 'uuid_mslong': 14679995526706056586}}, 'perms2': {'global_access': 0, 'owner': '27b8a85e67fe427d9ebc42e690325176', 'owner_access': 7, 'share': []}, 'uuid': 'cbb9d227-51a3-4d8a-98af-fbf340c47a59'}, 'oper': 'CREATE', 'request-id': 'req-07be16a9-933d-4b39-8ce1-25a61163cee6', 'type': 'route_target', 'uuid': 'cbb9d227-51a3-4d8a-98af-fbf340c47a59'} 09/01/2025 01:56:22.816 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-c39fa905-e0e8-476a-979a-054ff309ef44', 'type': 'global_vrouter_config', 'uuid': '824fe8e8-2e04-42cf-81ac-5b76c7f8b538'} 09/01/2025 01:56:22.817 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-virtual-network', 'default-virtual-network'], 'oper': 'UPDATE', 'request-id': 'req-045732a8-49a7-48cb-9760-b91578d36dfe', 'type': 'routing_instance', 'uuid': 'd08c9dbf-20db-43cf-bfc7-0c46722f5453'} 09/01/2025 01:56:22.820 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['target:64512:8000003'], 'obj_dict': {'display_name': 'target:64512:8000003', 'fq_name': ['target:64512:8000003'], 'id_perms': {'created': '2025-09-01T01:56:22.302434', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:56:22.302434', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12058251247389599611, 'uuid_mslong': 1542603573894005145}}, 'perms2': {'global_access': 0, 'owner': '27b8a85e67fe427d9ebc42e690325176', 'owner_access': 7, 'share': []}, 'uuid': '15686dc7-0333-4199-a757-839f4511677b'}, 'oper': 'CREATE', 'request-id': 'req-55cc9b73-ec14-466a-b110-2e5f1b919a47', 'type': 'route_target', 'uuid': '15686dc7-0333-4199-a757-839f4511677b'} 09/01/2025 01:56:22.822 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-8edc46aa-663a-429f-9466-b9a90d021807', 'type': 'routing_instance', 'uuid': 'efa08bdb-dd5f-4027-83f4-45b15f3bb7b5'} 09/01/2025 01:56:22.831 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000001'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'deny'}, 'direction': '<>', 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000002'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000001'}], 'dynamic': False}, 'display_name': 'ip-fabric', 'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'id_perms': {'created': '2025-09-01T01:56:22.538553', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:56:22.538553', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9827072082500796160, 'uuid_mslong': 13982518562691301760}}, 'parent_type': 'virtual-network', 'parent_uuid': '5e021764-73b8-4f96-ab85-adf191959170', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c20be28c-da85-4180-8860-c5fe339e3f00'}, 'oper': 'CREATE', 'request-id': 'req-759ef23b-ed98-453e-9bb5-685ddec9bf73', 'type': 'access_control_list', 'uuid': 'c20be28c-da85-4180-8860-c5fe339e3f00'} 09/01/2025 01:56:22.832 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'ingress-access-control-list'], 'oper': 'UPDATE', 'request-id': 'req-d788b31b-1bef-4f5c-b351-d3c8192c86ae', 'type': 'access_control_list', 'uuid': '23154715-826f-4f29-b73b-64e9340726d2'} 09/01/2025 01:56:22.833 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'egress-access-control-list'], 'oper': 'UPDATE', 'request-id': 'req-555ae619-cc7e-4a72-b825-06fd54ee8aae', 'type': 'access_control_list', 'uuid': 'c0ca385f-220c-4c3c-b088-c99e2968c30e'} 09/01/2025 01:56:22.834 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:22.835 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Down description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 09/01/2025 01:56:22.835 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:22.842 7fd13edd9cc0 [contrail-schema] [WARNING]: RabbitMQ drainer connection ESTABLISHED 09/01/2025 01:56:22.842 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:22.843 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:22.843 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:22.850 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['target:64512:8000000'], 'obj_dict': {'display_name': 'target:64512:8000000', 'fq_name': ['target:64512:8000000'], 'id_perms': {'created': '2025-09-01T01:56:21.892449', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:56:21.892449', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9906866012233534808, 'uuid_mslong': 1099819438931527018}}, 'perms2': {'global_access': 0, 'owner': '27b8a85e67fe427d9ebc42e690325176', 'owner_access': 7, 'share': []}, 'uuid': '0f4357f3-de95-456a-897c-422638920d58'}, 'oper': 'CREATE', 'request-id': 'req-8b8dd430-b9f8-4a92-af04-c5f4006ee126', 'type': 'route_target', 'uuid': '0f4357f3-de95-456a-897c-422638920d58'} 09/01/2025 01:56:22.851 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'dci-network', '__default__'], 'oper': 'UPDATE', 'request-id': 'req-9fbf836e-8fdf-4d4e-89b2-4b7bec2c7e50', 'type': 'routing_instance', 'uuid': '3abc5d2d-5e7d-442a-b101-e08c43bc6ef8'} 09/01/2025 01:56:22.853 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['target:64512:8000001'], 'obj_dict': {'display_name': 'target:64512:8000001', 'fq_name': ['target:64512:8000001'], 'id_perms': {'created': '2025-09-01T01:56:21.990808', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:56:21.990808', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10275245882271155766, 'uuid_mslong': 982427147137075297}}, 'perms2': {'global_access': 0, 'owner': '27b8a85e67fe427d9ebc42e690325176', 'owner_access': 7, 'share': []}, 'uuid': '0da24849-02ce-4861-8e99-01b078914636'}, 'oper': 'CREATE', 'request-id': 'req-a900cab5-238e-4f77-8714-a9f66b5200ec', 'type': 'route_target', 'uuid': '0da24849-02ce-4861-8e99-01b078914636'} 09/01/2025 01:56:22.854 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'dci-network', 'dci-network'], 'oper': 'UPDATE', 'request-id': 'req-78a994d8-0626-475d-a558-d2ae3794ed7b', 'type': 'routing_instance', 'uuid': '1ad7f85c-cbfe-4577-90e4-e28e82635f8c'} 09/01/2025 01:56:22.855 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['target:64512:8000002'], 'obj_dict': {'display_name': 'target:64512:8000002', 'fq_name': ['target:64512:8000002'], 'id_perms': {'created': '2025-09-01T01:56:22.131768', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:56:22.131768', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11002289436871653977, 'uuid_mslong': 14679995526706056586}}, 'perms2': {'global_access': 0, 'owner': '27b8a85e67fe427d9ebc42e690325176', 'owner_access': 7, 'share': []}, 'uuid': 'cbb9d227-51a3-4d8a-98af-fbf340c47a59'}, 'oper': 'CREATE', 'request-id': 'req-07be16a9-933d-4b39-8ce1-25a61163cee6', 'type': 'route_target', 'uuid': 'cbb9d227-51a3-4d8a-98af-fbf340c47a59'} 09/01/2025 01:56:22.856 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-c39fa905-e0e8-476a-979a-054ff309ef44', 'type': 'global_vrouter_config', 'uuid': '824fe8e8-2e04-42cf-81ac-5b76c7f8b538'} 09/01/2025 01:56:22.857 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-virtual-network', 'default-virtual-network'], 'oper': 'UPDATE', 'request-id': 'req-045732a8-49a7-48cb-9760-b91578d36dfe', 'type': 'routing_instance', 'uuid': 'd08c9dbf-20db-43cf-bfc7-0c46722f5453'} 09/01/2025 01:56:22.859 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['target:64512:8000003'], 'obj_dict': {'display_name': 'target:64512:8000003', 'fq_name': ['target:64512:8000003'], 'id_perms': {'created': '2025-09-01T01:56:22.302434', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:56:22.302434', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12058251247389599611, 'uuid_mslong': 1542603573894005145}}, 'perms2': {'global_access': 0, 'owner': '27b8a85e67fe427d9ebc42e690325176', 'owner_access': 7, 'share': []}, 'uuid': '15686dc7-0333-4199-a757-839f4511677b'}, 'oper': 'CREATE', 'request-id': 'req-55cc9b73-ec14-466a-b110-2e5f1b919a47', 'type': 'route_target', 'uuid': '15686dc7-0333-4199-a757-839f4511677b'} 09/01/2025 01:56:22.860 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-8edc46aa-663a-429f-9466-b9a90d021807', 'type': 'routing_instance', 'uuid': 'efa08bdb-dd5f-4027-83f4-45b15f3bb7b5'} 09/01/2025 01:56:22.867 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000001'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'deny'}, 'direction': '<>', 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000002'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000001'}], 'dynamic': False}, 'display_name': 'ip-fabric', 'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'id_perms': {'created': '2025-09-01T01:56:22.538553', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:56:22.538553', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9827072082500796160, 'uuid_mslong': 13982518562691301760}}, 'parent_type': 'virtual-network', 'parent_uuid': '5e021764-73b8-4f96-ab85-adf191959170', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c20be28c-da85-4180-8860-c5fe339e3f00'}, 'oper': 'CREATE', 'request-id': 'req-759ef23b-ed98-453e-9bb5-685ddec9bf73', 'type': 'access_control_list', 'uuid': 'c20be28c-da85-4180-8860-c5fe339e3f00'} 09/01/2025 01:56:22.868 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'ingress-access-control-list'], 'oper': 'UPDATE', 'request-id': 'req-d788b31b-1bef-4f5c-b351-d3c8192c86ae', 'type': 'access_control_list', 'uuid': '23154715-826f-4f29-b73b-64e9340726d2'} 09/01/2025 01:56:22.869 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'egress-access-control-list'], 'oper': 'UPDATE', 'request-id': 'req-555ae619-cc7e-4a72-b825-06fd54ee8aae', 'type': 'access_control_list', 'uuid': 'c0ca385f-220c-4c3c-b088-c99e2968c30e'} 09/01/2025 01:56:22.892 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements', 'operand2': {'json_value': '1'}, 'operation': 'size=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-conf-elements-inconsistency', 'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'id_perms': {'created': '2025-09-01T01:56:22.874935', 'creator': None, 'description': 'ContrailConfig has a list of ' 'elements - it should be a dict. ' 'Controllers have inconsistency in ' 'their data.', 'enable': True, 'last_modified': '2025-09-01T01:56:22.874935', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13707213498574533941, 'uuid_mslong': 401551790739309311}}, 'parent_type': 'global-system-config', 'parent_uuid': '38f19eae-05e2-496c-8f44-b9db734ce569', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '05929939-e5f0-42ff-be39-ce0d92f97535', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-76d9f329-9cb9-4945-81da-f04173a8c033', 'type': 'alarm', 'uuid': '05929939-e5f0-42ff-be39-ce0d92f97535'} 09/01/2025 01:56:22.940 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_ip_address', 'operand2': {'uve_attribute': 'VrouterAgent.control_ip'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-address-mismatch-compute', 'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'id_perms': {'created': '2025-09-01T01:56:22.928755', 'creator': None, 'description': 'Compute Node IP Address mismatch.', 'enable': True, 'last_modified': '2025-09-01T01:56:22.928755', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10598436790076336751, 'uuid_mslong': 4724792512980339102}}, 'parent_type': 'global-system-config', 'parent_uuid': '38f19eae-05e2-496c-8f44-b9db734ce569', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4191d5c1-ed9e-499e-9315-361b8eee6a6f', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-06fa47bc-0026-4b35-a7f8-174e556c2fcd', 'type': 'alarm', 'uuid': '4191d5c1-ed9e-499e-9315-361b8eee6a6f'} 09/01/2025 01:56:23.011 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.bgp_router_parameters.address', 'operand2': {'uve_attribute': 'BgpRouterState.bgp_router_ip_list'}, 'operation': 'not ' 'in'}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-address-mismatch-control', 'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'id_perms': {'created': '2025-09-01T01:56:23.004550', 'creator': None, 'description': 'Control Node IP Address mismatch.', 'enable': True, 'last_modified': '2025-09-01T01:56:23.004550', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10851083562822052220, 'uuid_mslong': 13252721359890825323}}, 'parent_type': 'global-system-config', 'parent_uuid': '38f19eae-05e2-496c-8f44-b9db734ce569', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b7eb1fdc-6386-406b-9696-cb024616a97c', 'uve_keys': {'uve_key': ['control-node']}}, 'oper': 'CREATE', 'request-id': 'req-e1a58d13-3fc6-415a-9b7e-f383e6d6d770', 'type': 'alarm', 'uuid': 'b7eb1fdc-6386-406b-9696-cb024616a97c'} 09/01/2025 01:56:23.099 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'BgpRouterState.num_up_bgp_peer', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'BgpRouterState.num_up_bgp_peer', 'operand2': {'uve_attribute': 'BgpRouterState.num_bgp_peer'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-bgp-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'id_perms': {'created': '2025-09-01T01:56:23.084176', 'creator': None, 'description': 'BGP peer mismatch. Not enough BGP ' 'peers are up.', 'enable': True, 'last_modified': '2025-09-01T01:56:23.084176', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9736829477468174299, 'uuid_mslong': 8069936643805364712}}, 'parent_type': 'global-system-config', 'parent_uuid': '38f19eae-05e2-496c-8f44-b9db734ce569', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6ffe2c9f-05ed-41e8-8720-2ad2630af7db', 'uve_keys': {'uve_key': ['control-node']}}, 'oper': 'CREATE', 'request-id': 'req-54e2df4c-db1e-4aa3-a091-656c9b9c97e9', 'type': 'alarm', 'uuid': '6ffe2c9f-05ed-41e8-8720-2ad2630af7db'} 09/01/2025 01:56:23.184 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-conf-incorrect', 'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'id_perms': {'created': '2025-09-01T01:56:23.171905', 'creator': None, 'description': 'ContrailConfig missing or ' 'incorrect. Configuration pushed to ' 'Ifmap as ContrailConfig is ' 'missing/incorrect.', 'enable': True, 'last_modified': '2025-09-01T01:56:23.171905', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12769097842699676307, 'uuid_mslong': 5978628720978512785}}, 'parent_type': 'global-system-config', 'parent_uuid': '38f19eae-05e2-496c-8f44-b9db734ce569', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '52f85b25-45df-4b91-b134-f2d598522a93', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-498da01f-0c99-4312-a66d-aced82d86a1f', 'type': 'alarm', 'uuid': '52f85b25-45df-4b91-b134-f2d598522a93'} 09/01/2025 01:56:23.269 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.disk_usage_info.*.percentage_partition_space_used', 'operand2': {'json_value': '[70, ' '90]'}, 'operation': 'range', 'variables': ['NodeStatus.disk_usage_info.__key']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-disk-usage-high', 'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'id_perms': {'created': '2025-09-01T01:56:23.259561', 'creator': None, 'description': 'Disk usage crosses high threshold ' 'limit.', 'enable': True, 'last_modified': '2025-09-01T01:56:23.259561', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10860765991155787745, 'uuid_mslong': 269723242804036128}}, 'parent_type': 'global-system-config', 'parent_uuid': '38f19eae-05e2-496c-8f44-b9db734ce569', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '03be3fdc-3b00-4220-96b9-31204b7be7e1', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-4262ebc7-97f2-444e-8e55-ab4005e59e97', 'type': 'alarm', 'uuid': '03be3fdc-3b00-4220-96b9-31204b7be7e1'} 09/01/2025 01:56:23.341 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.disk_usage_info.*.percentage_partition_space_used', 'operand2': {'json_value': '90'}, 'operation': '>', 'variables': ['NodeStatus.disk_usage_info.__key']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-disk-usage-critical', 'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'id_perms': {'created': '2025-09-01T01:56:23.334551', 'creator': None, 'description': 'Disk usage crosses critical ' 'threshold limit.', 'enable': True, 'last_modified': '2025-09-01T01:56:23.334551', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12789104832006102835, 'uuid_mslong': 5816089091841609693}}, 'parent_type': 'global-system-config', 'parent_uuid': '38f19eae-05e2-496c-8f44-b9db734ce569', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '50b6e636-cd3e-4fdd-b17c-0715caf49f33', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-18aa68f5-281b-4c9d-b8b8-968a1fad58a8', 'type': 'alarm', 'uuid': '50b6e636-cd3e-4fdd-b17c-0715caf49f33'} 09/01/2025 01:56:23.411 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-node-status', 'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'id_perms': {'created': '2025-09-01T01:56:23.404571', 'creator': None, 'description': 'Node Failure. NodeStatus UVE not ' 'present.', 'enable': True, 'last_modified': '2025-09-01T01:56:23.404571', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9323039891996661415, 'uuid_mslong': 11565774787221277774}}, 'parent_type': 'global-system-config', 'parent_uuid': '38f19eae-05e2-496c-8f44-b9db734ce569', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a081e2e4-107e-4c4e-8162-1762dd41d6a7', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-43e75ee2-0e81-4094-b851-383919996016', 'type': 'alarm', 'uuid': 'a081e2e4-107e-4c4e-8162-1762dd41d6a7'} 09/01/2025 01:56:23.476 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.build_info', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-partial-sysinfo', 'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'id_perms': {'created': '2025-09-01T01:56:23.469931', 'creator': None, 'description': 'System Info Incomplete.', 'enable': True, 'last_modified': '2025-09-01T01:56:23.469931', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9304822625772062689, 'uuid_mslong': 3067822192704113316}}, 'parent_type': 'global-system-config', 'parent_uuid': '38f19eae-05e2-496c-8f44-b9db734ce569', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2a931807-be30-4aa4-8121-5ee10b2947e1', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-8b47ea0d-3da4-46c4-bfec-702a7665aa3f', 'type': 'alarm', 'uuid': '2a931807-be30-4aa4-8121-5ee10b2947e1'} 09/01/2025 01:56:23.542 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.process_status', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'NodeStatus.process_status.state', 'operand2': {'json_value': '"Functional"'}, 'operation': '!=', 'variables': ['NodeStatus.process_status.module_id', 'NodeStatus.process_status.instance_id']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-process-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'id_perms': {'created': '2025-09-01T01:56:23.535766', 'creator': None, 'description': 'Process(es) reporting as ' 'non-functional.', 'enable': True, 'last_modified': '2025-09-01T01:56:23.535766', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11805350668708503676, 'uuid_mslong': 9027630143618696667}}, 'parent_type': 'global-system-config', 'parent_uuid': '38f19eae-05e2-496c-8f44-b9db734ce569', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7d4895c9-0200-45db-a3d5-07e2c14a607c', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-8134d9f9-c370-4295-9172-309568ba76cd', 'type': 'alarm', 'uuid': '7d4895c9-0200-45db-a3d5-07e2c14a607c'} 09/01/2025 01:56:23.615 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.process_info', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'NodeStatus.process_info.process_state', 'operand2': {'json_value': '"PROCESS_STATE_RUNNING"'}, 'operation': '!=', 'variables': ['NodeStatus.process_info.process_name']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-process-status', 'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'id_perms': {'created': '2025-09-01T01:56:23.606325', 'creator': None, 'description': 'Process Failure.', 'enable': True, 'last_modified': '2025-09-01T01:56:23.606325', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9909032825796266958, 'uuid_mslong': 4775577704002765225}}, 'parent_type': 'global-system-config', 'parent_uuid': '38f19eae-05e2-496c-8f44-b9db734ce569', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4246429e-a45c-41a9-8983-f4dad1458bce', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-e71c5f18-61cc-4c06-ad1b-9d9699dfd807', 'type': 'alarm', 'uuid': '4246429e-a45c-41a9-8983-f4dad1458bce'} 09/01/2025 01:56:23.696 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_refs', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'ProuterData.connected_agent_list', 'operand2': {'json_value': '1'}, 'operation': 'size!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-prouter-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'id_perms': {'created': '2025-09-01T01:56:23.686927', 'creator': None, 'description': 'Prouter connectivity to controlling ' 'tor agent does not exist we look ' 'for non-empty value for ' 'connected_agent_list', 'enable': True, 'last_modified': '2025-09-01T01:56:23.686927', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11605371510303753011, 'uuid_mslong': 13942754282054962701}}, 'parent_type': 'global-system-config', 'parent_uuid': '38f19eae-05e2-496c-8f44-b9db734ce569', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c17e9d25-cc71-4e0d-a10e-8fe696180333', 'uve_keys': {'uve_key': ['prouter']}}, 'oper': 'CREATE', 'request-id': 'req-5fb42e9a-cf41-4e0d-a937-516a108a8f3b', 'type': 'alarm', 'uuid': 'c17e9d25-cc71-4e0d-a10e-8fe696180333'} 09/01/2025 01:56:23.834 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_refs', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'ProuterData.tsn_agent_list', 'operand2': {'json_value': '1'}, 'operation': 'size!='}, {'operand1': 'ProuterData.gateway_mode', 'operand2': {'json_value': '"SERVER"'}, 'operation': '!='}]}, {'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_refs', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'ProuterData.tsn_agent_list', 'operand2': {'json_value': '0'}, 'operation': 'size!='}, {'operand1': 'ProuterData.gateway_mode', 'operand2': {'json_value': '"SERVER"'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-prouter-tsn-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'id_perms': {'created': '2025-09-01T01:56:23.775191', 'creator': None, 'description': 'Prouter connectivity to controlling ' 'tsn agent does not exist we look ' 'for non-empty value for ' 'tsn_agent_list', 'enable': True, 'last_modified': '2025-09-01T01:56:23.775191', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11305459433293988792, 'uuid_mslong': 10975156150797551114}}, 'parent_type': 'global-system-config', 'parent_uuid': '38f19eae-05e2-496c-8f44-b9db734ce569', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '984f965e-cabb-460a-9ce5-0f74a813c3b8', 'uve_keys': {'uve_key': ['prouter']}}, 'oper': 'CREATE', 'request-id': 'req-b17726e5-5ef3-4c99-b321-94edb821d6de', 'type': 'alarm', 'uuid': '984f965e-cabb-460a-9ce5-0f74a813c3b8'} 09/01/2025 01:56:23.925 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'StorageCluster.info_stats.status', 'operand2': {'json_value': '0'}, 'operation': '!=', 'variables': ['StorageCluster.info_stats.health_summary']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-storage-cluster-state', 'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'id_perms': {'created': '2025-09-01T01:56:23.911037', 'creator': None, 'description': 'Storage Cluster warning/errors.', 'enable': True, 'last_modified': '2025-09-01T01:56:23.911037', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10764744346370981683, 'uuid_mslong': 12712140248492951266}}, 'parent_type': 'global-system-config', 'parent_uuid': '38f19eae-05e2-496c-8f44-b9db734ce569', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b06a9834-465e-46e2-9564-0df2ef563f33', 'uve_keys': {'uve_key': ['storage-cluster']}}, 'oper': 'CREATE', 'request-id': 'req-10419831-15d1-40bf-83ec-5472e84c971b', 'type': 'alarm', 'uuid': 'b06a9834-465e-46e2-9564-0df2ef563f33'} 09/01/2025 01:56:24.018 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.down_interface_count', 'operand2': {'json_value': '1'}, 'operation': '>=', 'variables': ['VrouterAgent.error_intf_list', 'VrouterAgent.no_config_intf_list']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-vrouter-interface', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'id_perms': {'created': '2025-09-01T01:56:24.005826', 'creator': None, 'description': 'Vrouter interface(s) down.', 'enable': True, 'last_modified': '2025-09-01T01:56:24.005826', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13267098328660119858, 'uuid_mslong': 12507144282433670629}}, 'parent_type': 'global-system-config', 'parent_uuid': '38f19eae-05e2-496c-8f44-b9db734ce569', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ad924d75-8d04-4de5-b81e-33a347f71132', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-fe1fd7c5-f3da-4cc1-bbf9-7e031b5ef6e8', 'type': 'alarm', 'uuid': 'ad924d75-8d04-4de5-b81e-33a347f71132'} 09/01/2025 01:56:24.092 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'BgpRouterState.num_up_xmpp_peer', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'BgpRouterState.num_up_xmpp_peer', 'operand2': {'uve_attribute': 'BgpRouterState.num_xmpp_peer'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-xmpp-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'id_perms': {'created': '2025-09-01T01:56:24.085409', 'creator': None, 'description': 'XMPP peer mismatch.', 'enable': True, 'last_modified': '2025-09-01T01:56:24.085409', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10613316307313790156, 'uuid_mslong': 15048477777944463074}}, 'parent_type': 'global-system-config', 'parent_uuid': '38f19eae-05e2-496c-8f44-b9db734ce569', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd0d6eecf-0cbd-46e2-934a-12f3224c8ccc', 'uve_keys': {'uve_key': ['control-node']}}, 'oper': 'CREATE', 'request-id': 'req-86617697-b8e2-4808-9020-d97c77929c01', 'type': 'alarm', 'uuid': 'd0d6eecf-0cbd-46e2-934a-12f3224c8ccc'} 09/01/2025 01:56:24.181 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'XmppPeerInfoData.close_reason', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'XmppPeerInfoData.state_info.state', 'operand2': {'json_value': '"Established"'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-xmpp-close-reason', 'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'id_perms': {'created': '2025-09-01T01:56:24.171114', 'creator': None, 'description': 'XMPP connection closed towards ' 'peer, ' 'alarm has close reason', 'enable': True, 'last_modified': '2025-09-01T01:56:24.171114', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10883433430889243905, 'uuid_mslong': 5037750801242341892}}, 'parent_type': 'global-system-config', 'parent_uuid': '38f19eae-05e2-496c-8f44-b9db734ce569', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '45e9afa9-9efd-4204-9709-b90ae0c3a501', 'uve_keys': {'uve_key': ['xmpp-peer']}}, 'oper': 'CREATE', 'request-id': 'req-1e1eb49c-bf50-4a0b-a98b-3143e3e7af31', 'type': 'alarm', 'uuid': '45e9afa9-9efd-4204-9709-b90ae0c3a501'} 09/01/2025 01:56:24.254 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.all_core_file_list', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'NodeStatus.all_core_file_list', 'operand2': {'json_value': '0'}, 'operation': 'size!='}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-core-files', 'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'id_perms': {'created': '2025-09-01T01:56:24.243849', 'creator': None, 'description': 'A core file has been generated on ' 'the node.', 'enable': True, 'last_modified': '2025-09-01T01:56:24.243849', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13748926219152346334, 'uuid_mslong': 8461053901492079267}}, 'parent_type': 'global-system-config', 'parent_uuid': '38f19eae-05e2-496c-8f44-b9db734ce569', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '756bb3b1-dfde-4aa3-becd-ff8d27a14cde', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-3fbdd740-fd90-4e15-bfe8-ec9a33a0b985', 'type': 'alarm', 'uuid': '756bb3b1-dfde-4aa3-becd-ff8d27a14cde'} 09/01/2025 01:56:24.343 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks', 'operand2': {'json_value': '300'}, 'operation': '>='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-pending-cassandra-compaction-tasks', 'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'id_perms': {'created': '2025-09-01T01:56:24.333079', 'creator': None, 'description': 'Pending compaction tasks in ' 'cassandra crossed the configured ' 'threshold.', 'enable': True, 'last_modified': '2025-09-01T01:56:24.333079', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12891207850805120279, 'uuid_mslong': 16490720913298967380}}, 'parent_type': 'global-system-config', 'parent_uuid': '38f19eae-05e2-496c-8f44-b9db734ce569', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e4dacf4c-8f4a-4b54-b2e6-c53d60f74d17', 'uve_keys': {'uve_key': ['database-nodeconfig-database-node']}}, 'oper': 'CREATE', 'request-id': 'req-16c957d4-ef35-4d16-bc00-d578aebec520', 'type': 'alarm', 'uuid': 'e4dacf4c-8f4a-4b54-b2e6-c53d60f74d17'} 09/01/2025 01:56:24.429 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.running_package_version', 'operand2': {'uve_attribute': 'NodeStatus.installed_package_version'}, 'operation': '!='}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-package-version-mismatch', 'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'id_perms': {'created': '2025-09-01T01:56:24.417640', 'creator': None, 'description': 'There is a mismatch between ' 'installed and running package ' 'version.', 'enable': True, 'last_modified': '2025-09-01T01:56:24.417640', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10811203628475999079, 'uuid_mslong': 9751278193947004441}}, 'parent_type': 'global-system-config', 'parent_uuid': '38f19eae-05e2-496c-8f44-b9db734ce569', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '87537fda-5839-4e19-9609-1c6b7db9e367', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-4738224f-ef2d-48ba-b1e9-77c2b130e881', 'type': 'alarm', 'uuid': '87537fda-5839-4e19-9609-1c6b7db9e367'} 09/01/2025 01:56:24.450 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:24.452 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:24.452 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:24.453 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:24.453 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:24.453 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:24.453 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:24.454 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:24.454 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:24.455 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:24.455 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:24.455 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:24.455 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:56:24.455 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:24.523 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.res_limit', 'operand2': {'json_value': 'true'}, 'operation': '==', 'variables': ['VrouterAgent.vr_limit_exceeded_list']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-vrouter-limit-exceeded', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'id_perms': {'created': '2025-09-01T01:56:24.510146', 'creator': None, 'description': 'Agent resource usage exceeded ' 'configured watermark for resource.', 'enable': True, 'last_modified': '2025-09-01T01:56:24.510146', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10402200013110493255, 'uuid_mslong': 5364210485056981659}}, 'parent_type': 'global-system-config', 'parent_uuid': '38f19eae-05e2-496c-8f44-b9db734ce569', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4a718103-ee3f-4a9b-905c-09cc7803c047', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-3319c6ba-ced4-4d6b-8a5d-c61eb5dbe705', 'type': 'alarm', 'uuid': '4a718103-ee3f-4a9b-905c-09cc7803c047'} 09/01/2025 01:56:24.622 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.res_table_limit', 'operand2': {'json_value': 'true'}, 'operation': '==', 'variables': ['VrouterAgent.vr_limit_exceeded_list']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-vrouter-table-limit-exceeded', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'id_perms': {'created': '2025-09-01T01:56:24.608648', 'creator': None, 'description': 'Agent resource usage exceeded table ' 'size for resource in vrouter.', 'enable': True, 'last_modified': '2025-09-01T01:56:24.608648', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13099121594750311324, 'uuid_mslong': 7485663691657989736}}, 'parent_type': 'global-system-config', 'parent_uuid': '38f19eae-05e2-496c-8f44-b9db734ce569', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '67e26b77-8150-4e68-b5c9-6db034bd9b9c', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-31a0be84-5e88-4125-9e41-e5337ad2870d', 'type': 'alarm', 'uuid': '67e26b77-8150-4e68-b5c9-6db034bd9b9c'} 09/01/2025 01:56:24.707 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.l3mh_phy_interface_down', 'operand2': {'json_value': 'true'}, 'operation': '==', 'variables': ['VrouterAgent.vr_l3mh_intf_list']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-vrouter-l3mh-physical-interface-link-down', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'id_perms': {'created': '2025-09-01T01:56:24.695200', 'creator': None, 'description': 'On l3 multihomed compute one or ' 'more physical interfaces are ' 'Inactive.', 'enable': True, 'last_modified': '2025-09-01T01:56:24.695200', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12204224033860072292, 'uuid_mslong': 12696640556796562436}}, 'parent_type': 'global-system-config', 'parent_uuid': '38f19eae-05e2-496c-8f44-b9db734ce569', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b0338751-14ad-4c04-a95e-1d191983b364', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-38436e15-27cc-4370-a094-93611edda716', 'type': 'alarm', 'uuid': 'b0338751-14ad-4c04-a95e-1d191983b364'} 09/01/2025 01:56:25.526 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-fd76ce42-d0e7-4391-8921-754ac861fdb2', 'type': 'global_vrouter_config', 'uuid': '824fe8e8-2e04-42cf-81ac-5b76c7f8b538'} 09/01/2025 01:56:26.400 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-8668bce3-c2ac-4dad-858d-55d32c3b4029', 'type': 'global_vrouter_config', 'uuid': '824fe8e8-2e04-42cf-81ac-5b76c7f8b538'} 09/01/2025 01:56:27.268 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-7b99ca5f-3c9a-4d3c-b718-02b80f79f756', 'type': 'global_system_config', 'uuid': '38f19eae-05e2-496c-8f44-b9db734ce569'} 09/01/2025 01:56:28.454 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:28.457 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:28.457 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:28.458 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:28.458 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:28.459 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:28.459 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:28.460 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:28.460 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:28.461 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:28.461 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:28.461 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:28.461 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:56:28.461 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:32.458 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:32.460 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:32.460 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:32.460 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:32.460 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:32.460 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:32.460 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:32.461 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:32.461 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:32.461 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:32.461 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:32.461 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:32.461 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:56:32.461 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:36.460 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:36.462 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:36.462 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:36.462 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:36.462 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:36.462 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:36.462 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:36.463 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:36.463 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:36.463 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:36.463 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:36.463 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:36.463 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:56:36.463 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:40.464 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:40.465 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:40.465 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:40.465 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:40.465 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:40.466 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:40.466 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:40.466 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:40.466 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:40.466 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:40.466 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:40.466 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:40.466 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:56:40.466 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:44.468 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:44.470 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:44.471 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:44.471 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:44.471 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:44.472 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:44.472 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:44.473 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:44.473 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:44.473 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:44.474 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:44.474 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:44.474 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:56:44.474 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:48.471 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:48.473 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:48.473 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:48.474 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:48.474 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:48.474 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:48.474 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:48.475 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:48.475 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:48.476 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:48.476 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:48.476 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:48.476 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:56:48.476 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:52.473 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:52.474 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:52.475 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:52.475 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:52.475 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:52.475 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:52.475 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:52.475 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:52.476 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:52.476 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:52.476 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:52.476 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:52.476 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:56:52.476 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:56.477 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:56:56.479 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:56:56.479 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:56:56.479 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:56.480 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:56:56.480 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:56:56.480 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:56:56.480 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:56:56.481 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:56.481 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:56:56.481 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:56.481 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:56:56.481 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:56:56.482 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:00.479 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:00.481 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:00.481 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:00.481 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:00.481 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:00.481 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:00.481 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:00.482 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:00.482 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:00.482 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:00.482 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:00.482 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:00.482 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:57:00.482 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:04.483 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:04.486 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:04.486 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:04.486 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:04.487 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:04.487 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:04.487 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:04.488 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:04.489 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:04.489 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:04.490 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:04.490 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:04.490 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:57:04.491 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:08.489 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:08.491 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:08.492 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:08.492 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:08.492 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:08.493 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:08.493 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:08.494 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:08.494 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:08.494 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:08.495 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:08.495 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:08.495 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:57:08.495 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:12.492 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:12.494 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:12.495 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:12.495 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:12.495 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:12.495 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:12.496 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:12.496 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:12.497 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:12.497 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:12.497 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:12.498 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:12.498 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:57:12.498 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:16.496 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:16.498 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:16.498 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:16.499 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:16.499 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:16.499 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:16.499 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:16.500 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:16.500 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:16.501 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:16.501 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:16.501 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:16.502 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:57:16.502 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:20.499 7fd13edd97c0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:20.500 7fd13edd97c0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:20.500 7fd13edd97c0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:20.500 7fd13edd97c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:20.500 7fd13edd97c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:20.500 7fd13edd97c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:20.500 7fd13edd97c0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:20.501 7fd13edd97c0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:20.501 7fd13edd97c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:20.501 7fd13edd97c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:20.501 7fd13edd97c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:20.501 7fd13edd97c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:20.501 7fd13edd97c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:57:20.501 7fd13edd97c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:24.500 7fd13edd97c0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:24.502 7fd13edd97c0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:24.503 7fd13edd97c0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:24.503 7fd13edd97c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:24.504 7fd13edd97c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:24.504 7fd13edd97c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:24.504 7fd13edd97c0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:24.505 7fd13edd97c0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:24.505 7fd13edd97c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:24.505 7fd13edd97c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:24.505 7fd13edd97c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:24.506 7fd13edd97c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:24.506 7fd13edd97c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:57:24.506 7fd13edd97c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:28.504 7fd13edd97c0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:28.506 7fd13edd97c0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:28.507 7fd13edd97c0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:28.507 7fd13edd97c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:28.507 7fd13edd97c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:28.508 7fd13edd97c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:28.508 7fd13edd97c0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:28.509 7fd13edd97c0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:28.509 7fd13edd97c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:28.509 7fd13edd97c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:28.510 7fd13edd97c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:28.510 7fd13edd97c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:28.510 7fd13edd97c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:57:28.510 7fd13edd97c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:32.509 7fd13edd97c0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:32.510 7fd13edd97c0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:32.510 7fd13edd97c0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:32.510 7fd13edd97c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:32.510 7fd13edd97c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:32.511 7fd13edd97c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:32.511 7fd13edd97c0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:32.511 7fd13edd97c0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:32.511 7fd13edd97c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:32.511 7fd13edd97c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:32.511 7fd13edd97c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:32.511 7fd13edd97c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:32.511 7fd13edd97c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:57:32.511 7fd13edd97c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:36.511 7fd13edd97c0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:36.514 7fd13edd97c0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:36.514 7fd13edd97c0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:36.514 7fd13edd97c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:36.515 7fd13edd97c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:36.515 7fd13edd97c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:36.515 7fd13edd97c0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:36.516 7fd13edd97c0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:36.516 7fd13edd97c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:36.517 7fd13edd97c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:36.517 7fd13edd97c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:36.517 7fd13edd97c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:36.517 7fd13edd97c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:57:36.518 7fd13edd97c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:40.514 7fd13edd97c0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:40.515 7fd13edd97c0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:40.516 7fd13edd97c0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:40.516 7fd13edd97c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:40.516 7fd13edd97c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:40.516 7fd13edd97c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:40.516 7fd13edd97c0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:40.516 7fd13edd97c0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:40.516 7fd13edd97c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:40.517 7fd13edd97c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:40.517 7fd13edd97c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:40.517 7fd13edd97c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:40.517 7fd13edd97c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:57:40.517 7fd13edd97c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:42.590 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-3992-1'], 'obj_dict': {'bgp_router_parameters': {'address': '10.20.0.17', 'address_families': {'family': ['route-target', 'inet-vpn', 'e-vpn', 'erm-vpn', 'inet6-vpn']}, 'admin_down': False, 'auth_data': None, 'autonomous_system': 64512, 'cluster_id': None, 'gateway_address': None, 'hold_time': 0, 'identifier': '10.20.0.17', 'ipv6_gateway_address': None, 'local_autonomous_system': None, 'port': 179, 'router_type': 'control-node', 'source_port': None, 'vendor': 'contrail'}, 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3992-1', 'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-3992-1'], 'id_perms': {'created': '2025-09-01T01:57:42.581692', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:57:42.581692', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10345386454374284862, 'uuid_mslong': 3459903081964587736}}, 'parent_type': 'routing-instance', 'parent_uuid': '609baddc-83d5-45f8-96c3-3bbd47130ba3', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '30040b85-8dc7-4ad8-8f92-322b051dfe3e'}, 'oper': 'CREATE', 'request-id': 'req-2a5dfa96-b8dc-4981-82ac-28de68991641', 'type': 'bgp_router', 'uuid': '30040b85-8dc7-4ad8-8f92-322b051dfe3e'} 09/01/2025 01:57:43.116 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-3ce5e647-c7bc-4b7d-bb0c-d2ff4f7f7bf8', 'type': 'global_system_config', 'uuid': '38f19eae-05e2-496c-8f44-b9db734ce569'} 09/01/2025 01:57:44.517 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:44.519 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:44.519 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:44.519 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:44.520 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:44.520 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:44.520 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:44.520 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:44.521 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:44.521 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:44.521 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:44.521 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:44.521 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:57:44.521 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:48.521 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:48.523 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:48.523 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:48.524 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:48.524 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:48.524 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:48.524 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:48.525 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:48.525 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:48.526 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:48.526 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:48.526 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:48.527 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:57:48.527 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:52.524 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:52.527 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:52.527 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:52.527 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:52.528 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:52.528 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:52.528 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:52.529 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:52.529 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:52.530 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:52.530 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:52.530 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:52.531 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:57:52.531 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:56.529 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:57:56.532 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:57:56.533 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:57:56.533 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:56.534 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:57:56.534 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:57:56.534 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:57:56.535 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:57:56.535 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:56.536 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:57:56.536 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:56.537 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:57:56.537 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:57:56.537 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:00.534 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:00.536 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:00.536 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:00.536 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:00.537 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:00.537 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:00.537 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:00.538 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:00.538 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:00.539 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:00.539 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:00.539 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:00.540 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:58:00.540 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:04.537 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:04.539 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:04.539 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:04.539 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:04.540 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:04.540 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:04.540 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:04.541 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:04.541 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:04.542 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:04.542 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:04.542 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:04.542 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:58:04.543 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:08.541 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:08.544 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:08.544 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:08.544 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:08.545 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:08.545 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:08.545 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:08.546 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:08.546 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:08.547 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:08.547 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:08.547 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:08.547 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:58:08.547 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:12.545 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:12.547 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:12.547 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:12.547 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:12.548 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:12.548 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:12.548 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:12.549 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:12.549 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:12.550 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:12.550 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:12.550 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:12.550 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:58:12.550 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:16.547 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:16.550 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:16.550 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:16.550 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:16.551 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:16.551 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:16.551 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:16.552 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:16.552 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:16.553 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:16.553 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:16.553 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:16.553 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:58:16.553 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:20.551 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:20.552 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:20.553 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:20.553 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:20.553 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:20.553 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:20.554 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:20.554 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:20.554 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:20.555 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:20.555 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:20.555 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:20.555 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:58:20.555 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:21.609 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3992-1.'], 'obj_dict': {'database_node_ip_address': '10.0.0.254', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3992-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3992-1.'], 'id_perms': {'created': '2025-09-01T01:58:21.603824', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:58:21.603824', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13522251961883716098, 'uuid_mslong': 6650891309445434345}}, 'parent_type': 'global-system-config', 'parent_uuid': '38f19eae-05e2-496c-8f44-b9db734ce569', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5c4cb668-733a-4be9-bba8-b083ef686a02'}, 'oper': 'CREATE', 'request-id': 'req-2eb6efc2-b65e-477d-875a-57bdd1f7b27a', 'type': 'database_node', 'uuid': '5c4cb668-733a-4be9-bba8-b083ef686a02'} 09/01/2025 01:58:24.555 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:24.557 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:24.557 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:24.557 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:24.558 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:24.558 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:24.558 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:24.558 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:24.558 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:24.559 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:24.559 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:24.559 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:24.559 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:58:24.559 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:28.558 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:28.559 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:28.559 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:28.559 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:28.560 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:28.560 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:28.560 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:28.560 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:28.560 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:28.560 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:28.560 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:28.560 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:28.560 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:58:28.560 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:32.560 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:32.562 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:32.562 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:32.562 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:32.563 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:32.563 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:32.563 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:32.563 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:32.564 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:32.564 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:32.564 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:32.564 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:32.564 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:58:32.565 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:36.565 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:36.566 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:36.566 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:36.566 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:36.566 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:36.566 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:36.566 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:36.566 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:36.567 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:36.567 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:36.567 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:36.567 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:36.567 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:58:36.567 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:40.568 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:40.569 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:40.569 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:40.569 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:40.569 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:40.569 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:40.570 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:40.570 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:40.570 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:40.570 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:40.570 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:40.570 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:40.570 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:58:40.570 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:44.572 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:44.575 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:44.575 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:44.576 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:44.576 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:44.576 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:44.577 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:44.578 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:44.578 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:44.578 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:44.578 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:44.579 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:44.579 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:58:44.579 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:48.576 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:48.579 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:48.579 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:48.579 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:48.580 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:48.580 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:48.580 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:48.581 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:48.581 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:48.581 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:48.582 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:48.582 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:48.582 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:58:48.582 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:52.580 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:52.581 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:52.581 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:52.581 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:52.581 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:52.581 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:52.581 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:52.581 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:52.582 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:52.582 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:52.582 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:52.582 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:52.582 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:58:52.582 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:56.584 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:58:56.586 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:58:56.586 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:58:56.587 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:56.587 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:58:56.587 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:58:56.587 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:58:56.588 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:58:56.589 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:56.589 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:58:56.589 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:56.589 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:58:56.590 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:58:56.590 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:00.587 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:00.589 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:00.589 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:00.590 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:00.590 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:00.590 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:00.590 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:00.591 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:00.591 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:00.591 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:00.592 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:00.592 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:00.592 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:00.592 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:04.591 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:04.593 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:04.594 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:04.594 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:04.594 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:04.595 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:04.595 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:04.596 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:04.596 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:04.596 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:04.597 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:04.597 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:04.597 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:04.597 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:05.955 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3992-1.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.254', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3992-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3992-1.'], 'id_perms': {'created': '2025-09-01T01:59:05.943975', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:59:05.943975', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10801980332688434906, 'uuid_mslong': 5949089030653167583}}, 'parent_type': 'global-system-config', 'parent_uuid': '38f19eae-05e2-496c-8f44-b9db734ce569', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '528f68f4-2941-47df-95e8-57e198a666da'}, 'oper': 'CREATE', 'request-id': 'req-729ebb53-a7d3-4876-aa6e-45929115b4c8', 'type': 'analytics_node', 'uuid': '528f68f4-2941-47df-95e8-57e198a666da'} 09/01/2025 01:59:08.595 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:08.596 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:08.596 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:08.597 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:08.597 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:08.597 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:08.597 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:08.597 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:08.597 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:08.598 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:08.598 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:08.598 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:08.598 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:08.598 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:12.598 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:12.600 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:12.600 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:12.601 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:12.601 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:12.601 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:12.602 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:12.602 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:12.603 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:12.603 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:12.603 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:12.604 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:12.604 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:12.604 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:16.602 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:16.605 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:16.605 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:16.605 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:16.606 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:16.606 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:16.606 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:16.607 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:16.607 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:16.608 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:16.608 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:16.608 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:16.609 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:16.609 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:20.606 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:20.607 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:20.607 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:20.607 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:20.607 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:20.607 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:20.607 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:20.607 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:20.607 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:20.608 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:20.608 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:20.608 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:20.608 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:20.608 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:24.607 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:24.608 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:24.609 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:24.609 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:24.609 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:24.609 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:24.609 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:24.609 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:24.610 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:24.610 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:24.610 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:24.610 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:24.610 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:24.610 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:28.578 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3992-1.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.254', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3992-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3992-1.'], 'id_perms': {'created': '2025-09-01T01:59:28.568140', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:59:28.568140', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10362525483686141500, 'uuid_mslong': 5127378597392238562}}, 'parent_type': 'global-system-config', 'parent_uuid': '38f19eae-05e2-496c-8f44-b9db734ce569', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '47281bab-1681-47e2-8fcf-16063f0b9e3c'}, 'oper': 'CREATE', 'request-id': 'req-d758255e-9c4f-45d8-9754-4be8eda51a10', 'type': 'analytics_alarm_node', 'uuid': '47281bab-1681-47e2-8fcf-16063f0b9e3c'} 09/01/2025 01:59:28.609 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:28.610 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:28.610 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:28.610 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:28.610 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:28.610 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:28.610 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:28.610 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:28.611 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:28.611 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:28.611 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:28.611 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:28.611 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:28.611 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:32.611 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:32.613 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:32.613 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:32.613 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:32.614 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:32.614 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:32.614 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:32.614 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:32.614 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:32.615 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:32.615 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:32.615 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:32.615 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:32.615 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:36.614 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:36.616 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:36.616 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:36.616 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:36.617 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:36.617 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:36.617 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:36.618 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:36.618 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:36.619 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:36.619 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:36.619 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:36.619 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:36.619 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:40.616 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:40.618 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:40.618 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:40.618 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:40.618 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:40.618 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:40.618 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:40.619 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:40.619 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:40.619 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:40.619 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:40.619 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:40.619 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:40.619 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:42.560 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3992-1.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.254', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3992-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3992-1.'], 'id_perms': {'created': '2025-09-01T01:59:42.551873', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T01:59:42.551873', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12682759219656008150, 'uuid_mslong': 2370119825507566310}}, 'parent_type': 'global-system-config', 'parent_uuid': '38f19eae-05e2-496c-8f44-b9db734ce569', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '20e45b6c-827d-42e6-b002-36506b6821d6'}, 'oper': 'CREATE', 'request-id': 'req-cc1fd9bc-3d21-4140-9d67-d1085a4f2f87', 'type': 'analytics_snmp_node', 'uuid': '20e45b6c-827d-42e6-b002-36506b6821d6'} 09/01/2025 01:59:44.620 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:44.622 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:44.623 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:44.623 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:44.624 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:44.624 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:44.624 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:44.625 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:44.625 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:44.626 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:44.626 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:44.626 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:44.626 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:44.627 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:48.623 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:48.624 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:48.625 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:48.625 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:48.625 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:48.625 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:48.625 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:48.625 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:48.625 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:48.626 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:48.626 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:48.626 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:48.626 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:48.626 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:52.625 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:52.627 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:52.627 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:52.627 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:52.627 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:52.628 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:52.628 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:52.628 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:52.628 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:52.628 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:52.628 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:52.629 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:52.629 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:52.629 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:56.629 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 01:59:56.631 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 01:59:56.632 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 01:59:56.632 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:56.632 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 01:59:56.633 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 01:59:56.633 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 01:59:56.634 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 01:59:56.634 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:56.634 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 01:59:56.635 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:56.635 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 01:59:56.635 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 01:59:56.635 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:00.632 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:00.633 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:00.633 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:00.633 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:00.633 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:00.633 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:00.633 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:00.633 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:00.633 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:00.634 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:00.634 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:00.634 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:00.634 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:00.634 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:04.633 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:04.634 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:04.634 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:04.635 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:04.635 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:04.635 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:04.635 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:04.635 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:04.635 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:04.635 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:04.635 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:04.635 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:04.636 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:04.636 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:08.635 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:08.638 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:08.638 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:08.638 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:08.639 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:08.639 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:08.639 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:08.640 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:08.640 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:08.641 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:08.641 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:08.641 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:08.642 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:08.642 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:12.638 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:12.640 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:12.640 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:12.640 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:12.641 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:12.641 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:12.641 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:12.641 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:12.641 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:12.642 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:12.642 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:12.642 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:12.642 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:12.642 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:16.641 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:16.643 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:16.644 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:16.644 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:16.644 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:16.644 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:16.645 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:16.645 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:16.646 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:16.646 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:16.646 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:16.646 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:16.647 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:16.647 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:20.645 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:20.646 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:20.646 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:20.646 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:20.646 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:20.646 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:20.647 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:20.647 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:20.647 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:20.647 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:20.647 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:20.647 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:20.648 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:20.648 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:24.646 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:24.649 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:24.649 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:24.650 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:24.650 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:24.650 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:24.651 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:24.651 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:24.652 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:24.652 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:24.652 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:24.652 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:24.653 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:24.653 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:28.650 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:28.652 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:28.653 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:28.653 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:28.653 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:28.653 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:28.654 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:28.654 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:28.655 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:28.655 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:28.655 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:28.655 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:28.656 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:28.656 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:32.653 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:32.656 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:32.656 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:32.657 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:32.657 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:32.658 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:32.658 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:32.659 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:32.659 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:32.660 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:32.660 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:32.660 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:32.660 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:32.660 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:36.656 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:36.658 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:36.658 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:36.659 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:36.659 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:36.659 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:36.659 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:36.660 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:36.660 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:36.660 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:36.660 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:36.661 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:36.661 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:36.661 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:40.660 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:40.662 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:40.662 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:40.662 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:40.662 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:40.662 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:40.662 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:40.663 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:40.663 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:40.663 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:40.663 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:40.663 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:40.663 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:40.663 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:44.662 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:44.664 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:44.665 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:44.665 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:44.666 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:44.666 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:44.666 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:44.667 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:44.667 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:44.668 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:44.668 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:44.668 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:44.668 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:44.668 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:48.665 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:48.667 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:48.667 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:48.667 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:48.668 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:48.668 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:48.668 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:48.668 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:48.669 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:48.669 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:48.669 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:48.669 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:48.669 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:48.669 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:52.668 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:52.670 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:52.670 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:52.671 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:52.671 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:52.671 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:52.671 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:52.672 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:52.672 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:52.672 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:52.673 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:52.673 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:52.673 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:52.673 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:56.671 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:00:56.673 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:00:56.673 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:00:56.673 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:56.673 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:00:56.674 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:00:56.674 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:00:56.674 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:00:56.674 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:56.675 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:00:56.675 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:56.675 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:00:56.675 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:00:56.675 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:00.674 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:00.675 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:00.675 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:00.675 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:00.675 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:00.676 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:00.676 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:00.676 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:00.676 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:00.676 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:00.676 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:00.676 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:00.676 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:00.676 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:04.677 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:04.680 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:04.680 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:04.681 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:04.681 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:04.682 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:04.682 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:04.683 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:04.683 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:04.684 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:04.684 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:04.684 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:04.684 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:04.684 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:08.682 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:08.684 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:08.685 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:08.685 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:08.686 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:08.686 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:08.686 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:08.687 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:08.687 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:08.688 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:08.688 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:08.688 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:08.688 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:08.688 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:12.685 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:12.687 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:12.687 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:12.687 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:12.687 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:12.688 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:12.688 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:12.688 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:12.688 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:12.688 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:12.688 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:12.688 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:12.688 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:12.688 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:16.688 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:16.691 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:16.691 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:16.691 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:16.692 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:16.692 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:16.692 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:16.693 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:16.693 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:16.694 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:16.694 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:16.694 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:16.694 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:16.694 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:20.693 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:20.697 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:20.697 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:20.697 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:20.697 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:20.697 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:20.697 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:20.697 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:20.697 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:20.698 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:20.698 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:20.698 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:20.698 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:20.698 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:24.697 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:24.699 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:24.699 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:24.699 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:24.699 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:24.699 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:24.699 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:24.700 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:24.700 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:24.700 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:24.700 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:24.700 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:24.700 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:24.700 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:28.701 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:28.703 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:28.703 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:28.703 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:28.704 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:28.704 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:28.704 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:28.705 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:28.705 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:28.705 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:28.705 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:28.706 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:28.706 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:28.706 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:32.705 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:32.706 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:32.706 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:32.706 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:32.706 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:32.706 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:32.707 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:32.707 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:32.707 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:32.707 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:32.707 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:32.707 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:32.707 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:32.707 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:36.706 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:36.708 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:36.708 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:36.708 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:36.708 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:36.709 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:36.709 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:36.709 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:36.709 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:36.710 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:36.710 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:36.710 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:36.710 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:36.710 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:40.710 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:40.712 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:40.713 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:40.713 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:40.714 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:40.714 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:40.714 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:40.715 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:40.715 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:40.716 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:40.716 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:40.716 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:40.716 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:40.716 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:44.715 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:44.717 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:44.717 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:44.718 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:44.718 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:44.718 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:44.718 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:44.719 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:44.720 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:44.720 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:44.720 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:44.720 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:44.721 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:44.721 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:48.717 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:48.719 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:48.720 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:48.720 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:48.721 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:48.721 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:48.721 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:48.722 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:48.722 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:48.723 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:48.723 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:48.723 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:48.723 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:48.724 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:52.720 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:52.722 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:52.723 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:52.723 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:52.723 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:52.724 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:52.724 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:52.725 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:52.725 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:52.725 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:52.726 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:52.726 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:52.726 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:52.726 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:56.725 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:01:56.727 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:01:56.727 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:01:56.728 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:56.728 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:01:56.728 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:01:56.728 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:01:56.729 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:01:56.730 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:56.730 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:01:56.730 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:56.730 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:01:56.731 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:01:56.731 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:00.728 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:00.730 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:00.730 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:00.730 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:00.730 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:00.731 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:00.731 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:00.731 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:00.731 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:00.732 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:00.732 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:00.732 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:00.732 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:00.732 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:04.731 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:04.734 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:04.734 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:04.734 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:04.735 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:04.735 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:04.735 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:04.736 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:04.736 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:04.736 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:04.737 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:04.737 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:04.737 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:04.737 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:08.737 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:08.742 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:08.742 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:08.742 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:08.743 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:08.743 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:08.743 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:08.744 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:08.744 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:08.745 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:08.745 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:08.745 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:08.746 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:08.746 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:12.742 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:12.745 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:12.745 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:12.745 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:12.746 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:12.746 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:12.746 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:12.747 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:12.747 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:12.748 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:12.748 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:12.748 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:12.749 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:12.749 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:16.745 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:16.747 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:16.748 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:16.748 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:16.748 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:16.748 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:16.749 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:16.749 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:16.750 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:16.750 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:16.750 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:16.750 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:16.751 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:16.751 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:20.750 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:20.752 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:20.753 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:20.753 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:20.754 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:20.754 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:20.754 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:20.755 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:20.755 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:20.756 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:20.756 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:20.756 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:20.757 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:20.757 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:24.753 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:24.756 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:24.756 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:24.756 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:24.757 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:24.757 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:24.757 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:24.758 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:24.758 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:24.759 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:24.759 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:24.759 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:24.759 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:24.759 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:28.334 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-72faeda3-d2b0-4e32-99fc-270f9df96566', 'type': 'global_system_config', 'uuid': '38f19eae-05e2-496c-8f44-b9db734ce569'} 09/01/2025 02:02:28.487 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3992-1'], 'obj_dict': {'display_name': 'cn-jenkins-deploy-platform-ansible-os-3992-1', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3992-1'], 'id_perms': {'created': '2025-09-01T02:02:28.460717', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T02:02:28.460717', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11539493739750933229, 'uuid_mslong': 13298779682352221738}}, 'parent_type': 'global-system-config', 'parent_uuid': '38f19eae-05e2-496c-8f44-b9db734ce569', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b88ec1a9-40c9-4e2a-a024-846addb2c2ed', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.17'}, 'oper': 'CREATE', 'request-id': 'req-82b84dd8-7f4e-413d-b483-2116dba14f65', 'type': 'virtual_router', 'uuid': 'b88ec1a9-40c9-4e2a-a024-846addb2c2ed'} 09/01/2025 02:02:28.756 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:28.758 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:28.758 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:28.759 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:28.759 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:28.759 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:28.759 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:28.760 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:28.761 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:28.761 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:28.761 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:28.761 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:28.762 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:28.762 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:28.864 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3992-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3992-1', 'vhost0'], 'id_perms': {'created': '2025-09-01T02:02:28.846248', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-01T02:02:28.846248', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9876995726292915272, 'uuid_mslong': 118707417928581946}}, 'parent_type': 'virtual-router', 'parent_uuid': 'b88ec1a9-40c9-4e2a-a024-846addb2c2ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '01a5bbc4-85d6-433a-8912-234851bd9448', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:01:a5:bb:c4:85']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '5e021764-73b8-4f96-ab85-adf191959170'}]}, 'oper': 'CREATE', 'request-id': 'req-4a51e9f4-714f-49fc-a54a-e7ab046530de', 'type': 'virtual_machine_interface', 'uuid': '01a5bbc4-85d6-433a-8912-234851bd9448'} 09/01/2025 02:02:28.871 7fd13edd9cc0 [contrail-schema] [DEBUG]: Process VPG collecting information of vlan_id and physical interface 09/01/2025 02:02:28.871 7fd13edd9cc0 [contrail-schema] [DEBUG]: Collected hostname: None 09/01/2025 02:02:28.871 7fd13edd9cc0 [contrail-schema] [DEBUG]: Process VPG collected vlan_id and physical interface and fabric 09/01/2025 02:02:29.476 7fd13edd9cc0 [contrail-schema] [WARNING]: Virtual-Network Evaluate Complete: VN Name (default-domain:default-project:ip-fabric): Duration (0.104) sec 09/01/2025 02:02:29.478 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3992-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-4a51e9f4-714f-49fc-a54a-e7ab046530de', 'type': 'virtual_machine_interface', 'uuid': '01a5bbc4-85d6-433a-8912-234851bd9448'} 09/01/2025 02:02:29.480 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:29.480 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] UveVirtualNetworkConfigTrace: data = << name = default-domain:default-project:ip-fabric connected_networks = [ ] partially_connected_networks = [ ] routing_instance_list = [ default-domain:default-project:ip-fabric:__default__, default-domain:default-project:ip-fabric:ip-fabric, ] total_acl_rules = 3 >> 09/01/2025 02:02:29.480 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:29.481 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:29.481 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] UveVirtualNetworkConfigTrace: data = << name = default-domain:default-project:ip-fabric connected_networks = [ ] partially_connected_networks = [ ] routing_instance_list = [ default-domain:default-project:ip-fabric:__default__, default-domain:default-project:ip-fabric:ip-fabric, ] total_acl_rules = 3 >> 09/01/2025 02:02:29.481 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:29.484 7fd13edd9cc0 [contrail-schema] [DEBUG]: Process VPG collecting information of vlan_id and physical interface 09/01/2025 02:02:29.484 7fd13edd9cc0 [contrail-schema] [DEBUG]: Collected hostname: None 09/01/2025 02:02:29.484 7fd13edd9cc0 [contrail-schema] [DEBUG]: Process VPG collected vlan_id and physical interface and fabric 09/01/2025 02:02:29.485 7fd13edd9cc0 [contrail-schema] [WARNING]: Virtual-Network Evaluate Complete: VN Name (default-domain:default-project:ip-fabric): Duration (0.000) sec 09/01/2025 02:02:29.486 7fd13edd9cc0 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-258ee4b7-b364-49f8-ace1-a85ef0cecfe7', 'type': 'access_control_list', 'uuid': 'c20be28c-da85-4180-8860-c5fe339e3f00'} 09/01/2025 02:02:29.486 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:29.486 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] UveVirtualNetworkConfigTrace: data = << name = default-domain:default-project:ip-fabric connected_networks = [ ] partially_connected_networks = [ ] routing_instance_list = [ default-domain:default-project:ip-fabric:__default__, default-domain:default-project:ip-fabric:ip-fabric, ] total_acl_rules = 3 >> 09/01/2025 02:02:29.486 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:29.486 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:29.486 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] UveVirtualNetworkConfigTrace: data = << name = default-domain:default-project:ip-fabric connected_networks = [ ] partially_connected_networks = [ ] routing_instance_list = [ default-domain:default-project:ip-fabric:__default__, default-domain:default-project:ip-fabric:ip-fabric, ] total_acl_rules = 3 >> 09/01/2025 02:02:29.486 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:32.759 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:32.761 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:32.761 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:32.762 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:32.762 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:32.762 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:32.763 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:32.764 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:32.764 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:32.764 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:32.765 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:32.765 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:32.765 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:32.765 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:36.763 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:36.764 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:36.764 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:36.764 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:36.765 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:36.765 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:36.765 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:36.765 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:36.765 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:36.765 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:36.765 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:36.765 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:36.766 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:36.766 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:40.768 7fd13f375180 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:02:40.771 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:40.773 7fd13edff7c0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:40.773 7fd13edff7c0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:40.773 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:40.774 7fd13edff7c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:40.774 7fd13edff7c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:40.774 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:40.775 7fd13edff7c0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:40.775 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:40.776 7fd13edff7c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:40.776 7fd13edff7c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:40.776 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:40.776 7fd13edff7c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:40.776 7fd13edff7c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:44.774 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:44.775 7fd13edff7c0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:44.775 7fd13edff7c0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:44.775 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:44.776 7fd13edff7c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:44.776 7fd13edff7c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:44.776 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:44.776 7fd13edff7c0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:44.776 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:44.776 7fd13edff7c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:44.776 7fd13edff7c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:44.776 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:44.776 7fd13edff7c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:44.777 7fd13edff7c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:48.777 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:48.778 7fd13edff7c0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:48.778 7fd13edff7c0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:48.778 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:48.779 7fd13edff7c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:48.779 7fd13edff7c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:48.779 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:48.779 7fd13edff7c0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:48.779 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:48.779 7fd13edff7c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:48.779 7fd13edff7c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:48.779 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:48.779 7fd13edff7c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:48.780 7fd13edff7c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:52.782 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:52.784 7fd13edff7c0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:52.785 7fd13edff7c0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:52.785 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:52.785 7fd13edff7c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:52.786 7fd13edff7c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:52.786 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:52.787 7fd13edff7c0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:52.787 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:52.788 7fd13edff7c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:52.788 7fd13edff7c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:52.789 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:52.789 7fd13edff7c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:52.789 7fd13edff7c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:53.645 7fd13edff7c0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:02:56.785 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:02:56.786 7fd13edff7c0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:02:56.787 7fd13edff7c0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:02:56.787 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:56.787 7fd13edff7c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:02:56.787 7fd13edff7c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:02:56.788 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:02:56.788 7fd13edff7c0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:02:56.788 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:56.789 7fd13edff7c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:02:56.789 7fd13edff7c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:56.789 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:02:56.789 7fd13edff7c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:02:56.789 7fd13edff7c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:00.788 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:00.790 7fd13edff7c0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:00.790 7fd13edff7c0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:00.790 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:00.790 7fd13edff7c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:00.790 7fd13edff7c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:00.790 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:00.790 7fd13edff7c0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:00.791 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:00.791 7fd13edff7c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:00.791 7fd13edff7c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:00.791 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:00.791 7fd13edff7c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:00.791 7fd13edff7c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:04.792 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:04.793 7fd13edff7c0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:04.794 7fd13edff7c0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:04.794 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:04.794 7fd13edff7c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:04.794 7fd13edff7c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:04.794 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:04.794 7fd13edff7c0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:04.794 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:04.795 7fd13edff7c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:04.795 7fd13edff7c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:04.795 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:04.795 7fd13edff7c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:04.795 7fd13edff7c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:06.674 7fd13edff7c0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:03:08.794 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:08.796 7fd13edff7c0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:08.796 7fd13edff7c0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:08.796 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:08.797 7fd13edff7c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:08.797 7fd13edff7c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:08.797 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:08.798 7fd13edff7c0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:08.798 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:08.798 7fd13edff7c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:08.798 7fd13edff7c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:08.799 7fd13edff7c0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:08.799 7fd13edff7c0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:08.799 7fd13edff7c0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:12.797 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:12.800 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:12.800 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:12.800 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:12.801 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:12.801 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:12.801 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:12.802 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:12.802 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:12.802 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:12.803 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:12.803 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:12.803 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:12.803 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:16.802 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:16.804 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:16.805 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:16.805 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:16.805 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:16.806 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:16.806 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:16.807 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:16.807 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:16.807 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:16.808 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:16.808 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:16.808 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:16.808 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:19.673 7fd13f375180 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:03:20.805 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:20.808 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:20.808 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:20.808 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:20.809 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:20.809 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:20.809 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:20.810 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:20.810 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:20.811 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:20.811 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:20.811 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:20.811 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:20.812 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:24.809 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:24.812 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:24.812 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:24.812 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:24.813 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:24.813 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:24.813 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:24.814 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:24.814 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:24.815 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:24.815 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:24.815 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:24.815 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:24.816 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:28.815 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:28.817 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:28.817 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:28.817 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:28.817 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:28.818 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:28.818 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:28.818 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:28.818 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:28.819 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:28.819 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:28.819 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:28.819 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:28.819 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:32.524 7fd13f375180 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:03:32.818 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:32.819 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:32.819 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:32.819 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:32.819 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:32.819 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:32.819 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:32.820 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:32.820 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:32.820 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:32.820 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:32.820 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:32.820 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:32.820 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:36.821 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:36.823 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:36.824 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:36.824 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:36.825 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:36.825 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:36.825 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:36.826 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:36.826 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:36.826 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:36.827 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:36.827 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:36.827 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:36.827 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:40.826 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:40.828 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:40.828 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:40.829 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:40.829 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:40.829 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:40.829 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:40.830 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:40.831 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:40.831 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:40.831 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:40.831 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:40.832 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:40.832 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:44.829 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:44.832 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:44.832 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:44.832 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:44.833 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:44.833 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:44.833 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:44.834 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:44.834 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:44.834 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:44.835 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:44.835 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:44.835 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:44.835 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:45.866 7fd13f375180 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:03:48.833 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:48.835 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:48.836 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:48.836 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:48.836 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:48.836 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:48.837 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:48.837 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:48.838 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:48.838 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:48.838 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:48.838 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:48.839 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:48.839 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:52.838 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:52.840 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:52.841 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:52.841 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:52.842 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:52.842 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:52.842 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:52.843 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:52.843 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:52.844 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:52.844 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:52.844 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:52.844 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:52.845 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:56.841 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:03:56.843 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:03:56.843 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:03:56.843 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:56.843 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:03:56.843 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:03:56.843 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:03:56.844 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:03:56.844 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:56.844 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:03:56.844 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:56.844 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:56.844 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:03:56.844 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:03:58.627 7fd13f375180 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:04:00.844 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:00.845 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:00.845 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:00.845 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:00.846 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:00.846 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:00.846 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:00.846 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:00.846 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:00.847 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:00.847 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:00.847 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:00.847 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:00.847 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:04.848 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:04.849 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:04.849 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:04.849 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:04.850 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:04.850 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:04.850 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:04.850 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:04.850 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:04.850 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:04.850 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:04.850 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:04.850 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:04.850 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:08.851 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:08.854 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:08.854 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:08.855 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:08.855 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:08.855 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:08.856 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:08.856 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:08.857 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:08.857 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:08.857 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:08.857 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:08.858 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:08.858 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:11.646 7fd13f375180 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:04:12.855 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:12.856 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:12.857 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:12.857 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:12.857 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:12.857 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:12.857 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:12.857 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:12.857 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:12.858 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:12.858 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:12.858 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:12.858 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:12.858 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:16.859 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:16.860 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:16.860 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:16.860 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:16.860 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:16.860 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:16.860 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:16.861 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:16.861 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:16.861 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:16.861 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:16.861 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:16.861 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:16.862 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:20.861 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:20.863 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:20.864 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:20.864 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:20.864 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:20.864 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:20.865 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:20.866 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:20.866 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:20.866 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:20.867 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:20.867 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:20.867 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:20.867 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:24.444 7fd13f375180 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:04:24.864 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:24.866 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:24.867 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:24.867 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:24.867 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:24.867 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:24.868 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:24.868 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:24.869 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:24.869 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:24.869 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:24.869 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:24.870 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:24.870 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:28.868 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:28.870 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:28.871 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:28.871 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:28.872 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:28.872 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:28.872 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:28.873 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:28.874 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:28.874 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:28.874 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:28.874 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:28.874 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:28.875 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:32.872 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:32.874 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:32.875 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:32.875 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:32.876 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:32.876 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:32.876 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:32.878 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:32.878 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:32.879 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:32.879 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:32.879 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:32.880 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:32.880 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:36.876 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:36.879 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:36.879 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:36.879 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:36.880 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:36.880 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:36.881 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:36.882 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:36.882 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:36.882 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:36.883 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:36.883 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:36.883 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:36.883 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:37.287 7fd13f375180 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:04:40.881 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:40.883 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:40.884 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:40.884 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:40.884 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:40.885 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:40.885 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:40.886 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:40.886 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:40.886 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:40.887 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:40.887 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:40.887 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:40.887 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:44.885 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:44.888 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:44.888 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:44.889 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:44.889 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:44.890 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:44.890 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:44.891 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:44.891 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:44.891 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:44.892 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:44.892 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:44.892 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:44.892 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:48.889 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:48.892 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:48.892 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:48.892 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:48.893 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:48.893 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:48.893 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:48.894 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:48.895 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:48.895 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:48.895 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:48.895 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:48.896 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:48.896 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:50.519 7fd13f375180 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:04:52.893 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:52.896 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:52.896 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:52.896 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:52.897 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:52.897 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:52.897 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:52.898 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:52.899 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:52.899 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:52.899 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:52.899 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:52.900 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:52.900 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:56.896 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:04:56.899 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:04:56.899 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:04:56.900 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:56.900 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:04:56.900 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:04:56.900 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:04:56.901 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:04:56.902 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:56.902 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:04:56.902 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:56.903 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:04:56.903 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:04:56.903 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:00.901 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:00.902 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:00.902 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:00.902 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:00.903 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:00.903 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:00.903 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:00.903 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:00.903 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:00.903 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:00.904 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:00.904 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:00.904 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:00.904 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:03.353 7fd13f375180 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:05:04.904 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:04.906 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:04.907 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:04.907 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:04.907 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:04.908 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:04.908 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:04.909 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:04.909 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:04.910 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:04.910 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:04.910 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:04.910 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:04.910 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:08.907 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:08.910 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:08.910 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:08.910 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:08.911 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:08.911 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:08.911 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:08.912 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:08.912 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:08.912 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:08.912 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:08.913 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:08.913 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:08.913 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:12.912 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:12.914 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:12.915 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:12.915 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:12.916 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:12.916 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:12.916 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:12.918 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:12.918 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:12.918 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:12.919 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:12.919 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:12.919 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:12.920 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:16.191 7fd13f375180 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:05:16.916 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:16.918 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:16.918 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:16.919 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:16.919 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:16.919 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:16.920 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:16.920 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:16.921 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:16.921 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:16.921 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:16.922 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:16.922 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:16.922 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:20.919 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:20.922 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:20.922 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:20.922 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:20.923 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:20.923 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:20.924 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:20.925 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:20.925 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:20.926 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:20.926 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:20.926 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:20.927 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:20.927 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:24.923 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:24.924 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:24.924 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:24.924 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:24.924 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:24.924 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:24.924 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:24.925 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:24.925 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:24.925 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:24.925 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:24.925 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:24.925 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:24.925 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:28.925 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:28.928 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:28.928 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:28.928 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:28.929 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:28.929 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:28.929 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:28.930 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:28.930 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:28.930 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:28.930 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:28.931 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:28.931 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:28.931 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:29.126 7fd13f375180 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:05:32.929 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:32.931 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:32.931 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:32.932 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:32.932 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:32.932 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:32.933 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:32.934 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:32.934 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:32.935 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:32.935 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:32.935 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:32.936 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:32.936 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:36.932 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:36.936 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:36.937 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:36.937 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:36.938 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:36.938 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:36.939 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:36.940 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:36.940 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:36.941 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:36.941 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:36.941 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:36.942 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:36.942 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:40.937 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:40.938 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:40.939 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:40.939 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:40.939 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:40.939 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:40.939 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:40.939 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:40.939 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:40.940 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:40.940 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:40.940 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:40.940 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:40.940 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:42.063 7fd13f375180 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:05:44.939 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:44.940 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:44.940 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:44.940 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:44.940 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:44.941 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:44.941 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:44.941 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:44.941 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:44.941 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:44.941 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:44.941 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:44.941 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:44.941 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:48.942 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:48.944 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:48.944 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:48.945 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:48.945 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:48.945 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:48.945 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:48.946 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:48.947 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:48.947 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:48.947 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:48.947 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:48.948 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:48.948 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:52.946 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:52.948 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:52.949 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:52.949 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:52.949 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:52.949 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:52.950 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:52.950 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:52.951 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:52.951 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:52.951 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:52.951 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:52.952 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:52.952 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:55.228 7fd13f375180 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:05:56.950 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:05:56.952 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:05:56.952 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:05:56.953 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:56.953 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:05:56.953 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:05:56.954 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:05:56.954 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:05:56.955 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:56.955 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:05:56.955 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:56.956 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:05:56.956 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:05:56.956 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:00.954 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:00.955 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:00.955 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:00.955 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:00.955 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:00.955 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:00.955 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:00.955 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:00.955 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:00.955 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:00.956 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:00.956 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:00.956 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:00.956 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:04.956 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:04.958 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:04.959 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:04.959 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:04.959 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:04.960 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:04.960 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:04.961 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:04.961 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:04.961 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:04.962 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:04.962 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:04.962 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:04.962 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:08.231 7fd13f375180 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:06:08.960 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:08.962 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:08.962 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:08.963 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:08.963 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:08.963 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:08.963 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:08.964 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:08.964 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:08.965 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:08.965 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:08.965 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:08.966 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:08.966 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:12.963 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:12.965 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:12.966 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:12.966 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:12.966 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:12.966 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:12.967 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:12.967 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:12.968 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:12.968 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:12.968 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:12.968 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:12.969 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:12.969 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:16.968 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:16.970 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:16.971 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:16.971 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:16.971 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:16.971 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:16.972 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:16.972 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:16.973 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:16.973 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:16.973 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:16.973 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:16.974 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:16.974 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:20.971 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:20.973 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:20.973 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:20.973 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:20.973 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:20.973 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:20.974 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:20.974 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:20.974 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:20.974 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:20.974 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:20.974 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:20.974 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:20.974 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:21.237 7fd13f375180 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:06:24.974 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:24.976 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:24.977 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:24.977 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:24.977 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:24.978 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:24.978 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:24.979 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:24.979 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:24.979 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:24.980 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:24.980 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:24.980 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:24.980 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:28.979 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:28.982 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:28.982 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:28.983 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:28.983 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:28.983 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:28.984 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:28.984 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:28.985 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:28.985 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:28.985 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:28.985 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:28.986 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:28.986 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:32.982 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:32.985 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:32.985 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:32.985 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:32.986 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:32.986 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:32.986 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:32.987 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:32.987 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:32.987 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:32.988 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:32.988 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:32.988 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:32.988 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:34.001 7fd13f375180 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:06:36.985 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:36.987 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:36.987 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:36.987 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:36.987 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:36.987 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:36.987 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:36.987 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:36.988 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:36.988 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:36.988 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:36.988 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:36.988 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:36.988 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:40.989 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:40.992 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:40.992 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:40.992 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:40.993 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:40.993 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:40.993 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:40.994 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:40.994 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:40.995 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:40.995 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:40.995 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:40.995 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:40.995 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:44.993 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:44.995 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:44.996 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:44.996 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:44.996 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:44.996 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:44.997 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:44.997 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:44.998 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:44.998 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:44.998 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:44.998 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:44.999 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:44.999 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:46.889 7fd13f375180 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:06:48.998 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:49.000 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:49.000 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:49.000 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:49.001 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:49.001 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:49.001 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:49.002 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:49.002 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:49.003 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:49.003 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:49.003 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:49.003 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:49.004 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:53.001 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:53.002 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:53.003 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:53.003 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:53.003 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:53.003 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:53.003 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:53.004 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:53.004 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:53.004 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:53.005 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:53.005 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:53.005 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:53.005 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:57.003 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:06:57.004 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:06:57.004 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:06:57.005 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:57.005 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:06:57.005 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:06:57.005 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:06:57.005 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:06:57.005 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:57.005 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:06:57.005 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:57.006 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:06:57.006 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:06:57.006 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:00.056 7fd13f375180 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:07:01.005 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:01.006 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:01.007 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:01.007 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:01.007 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:01.007 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:01.007 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:01.007 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:01.007 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:01.008 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:01.008 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:01.008 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:01.008 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:07:01.008 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:05.009 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:05.012 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:05.013 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:05.013 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:05.014 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:05.014 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:05.014 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:05.015 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:05.015 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:05.016 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:05.016 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:05.016 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:05.017 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:07:05.017 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:09.013 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:09.016 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:09.016 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:09.017 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:09.017 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:09.017 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:09.017 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:09.018 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:09.018 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:09.019 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:09.019 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:09.019 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:09.019 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:07:09.020 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:13.018 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:13.020 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:13.021 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:13.021 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:13.021 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:13.022 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:13.022 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:13.023 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:13.023 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:13.023 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:13.023 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:13.024 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:13.024 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:07:13.024 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:13.098 7fd13f375180 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:07:17.021 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:17.022 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:17.022 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:17.023 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:17.023 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:17.023 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:17.023 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:17.023 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:17.023 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:17.024 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:17.024 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:17.024 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:17.024 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:07:17.024 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:21.023 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:21.025 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:21.026 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:21.026 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:21.026 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:21.027 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:21.027 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:21.028 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:21.028 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:21.028 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:21.028 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:21.029 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:21.029 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:07:21.029 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:25.027 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:25.029 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:25.030 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:25.030 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:25.030 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:25.030 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:25.031 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:25.031 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:25.032 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:25.032 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:25.032 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:25.032 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:25.032 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:07:25.033 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:26.194 7fd13f375180 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:07:29.032 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:29.035 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:29.035 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:29.036 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:29.036 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:29.036 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:29.037 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:29.038 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:29.038 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:29.038 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:29.038 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:29.039 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:29.039 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:07:29.039 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:33.036 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:33.037 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:33.037 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:33.037 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:33.038 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:33.038 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:33.038 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:33.038 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:33.038 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:33.039 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:33.039 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:33.039 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:33.039 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:07:33.039 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:37.038 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:37.040 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:37.040 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:37.040 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:37.040 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:37.040 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:37.040 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:37.040 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:37.041 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:37.041 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:37.041 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:37.041 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:37.041 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:07:37.041 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:38.930 7fd13f375180 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:07:41.042 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:41.044 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:41.045 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:41.045 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:41.045 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:41.046 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:41.046 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:41.047 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:41.047 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:41.047 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:41.048 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:41.048 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:41.048 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:07:41.048 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:45.045 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:45.047 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:45.048 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:45.048 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:45.048 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:45.049 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:45.049 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:45.050 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:45.050 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:45.050 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:45.050 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:45.051 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:45.051 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:07:45.051 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:49.049 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:49.052 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:49.053 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:49.053 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:49.053 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:49.054 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:49.054 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:49.055 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:49.055 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:49.055 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:49.056 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:49.056 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:49.056 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:07:49.056 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:51.683 7fd13f375180 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:07:53.054 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:53.055 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:53.056 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:53.056 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:53.056 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:53.056 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:53.056 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:53.057 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:53.057 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:53.057 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:53.057 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:53.057 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:53.057 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:07:53.058 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:57.056 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:07:57.059 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:07:57.059 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:07:57.059 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:57.060 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:07:57.060 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:07:57.060 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:07:57.061 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:07:57.061 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:57.062 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:07:57.062 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:57.062 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:07:57.062 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:07:57.062 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:01.060 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:01.063 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:01.063 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:01.063 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:01.064 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:01.064 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:01.064 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:01.065 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:01.066 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:01.066 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:01.067 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:01.067 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:01.067 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:08:01.067 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:04.703 7fd13f375180 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:08:05.064 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:05.066 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:05.066 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:05.066 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:05.066 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:05.066 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:05.067 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:05.067 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:05.067 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:05.067 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:05.068 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:05.068 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:05.068 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:08:05.068 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:09.067 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:09.068 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:09.068 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:09.068 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:09.068 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:09.068 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:09.068 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:09.069 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:09.069 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:09.069 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:09.069 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:09.069 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:09.069 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:08:09.069 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:13.069 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:13.071 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:13.072 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:13.072 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:13.072 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:13.073 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:13.073 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:13.074 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:13.074 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:13.074 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:13.075 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:13.075 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:13.075 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:08:13.075 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:17.073 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:17.075 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:17.075 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:17.075 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:17.075 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:17.075 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:17.075 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:17.076 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:17.076 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:17.076 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:17.076 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:17.076 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:17.076 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:08:17.076 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:17.829 7fd13f375180 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:08:21.076 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:21.079 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:21.079 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:21.079 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:21.080 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:21.080 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:21.080 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:21.081 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:21.081 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:21.081 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:21.082 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:21.082 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:21.082 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:08:21.082 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:25.080 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:25.082 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:25.082 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:25.082 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:25.082 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:25.082 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:25.082 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:25.083 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:25.083 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:25.083 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:25.083 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:25.083 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:25.084 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:08:25.084 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:29.085 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:29.086 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:29.086 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:29.086 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:29.086 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:29.086 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:29.086 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:29.087 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:29.087 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:29.087 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:29.087 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:29.087 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:29.087 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:08:29.087 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:30.580 7fd13f375180 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:08:33.087 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:33.090 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:33.090 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:33.090 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:33.091 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:33.091 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:33.091 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:33.092 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:33.092 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:33.092 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:33.093 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:33.093 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:33.093 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:08:33.093 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:37.092 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:37.093 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:37.093 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:37.093 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:37.094 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:37.094 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:37.094 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:37.094 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:37.094 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:37.094 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:37.094 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:37.095 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:37.095 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:08:37.095 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:41.095 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:41.096 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:41.096 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:41.096 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:41.096 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:41.097 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:41.097 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:41.097 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:41.097 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:41.097 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:41.097 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:41.098 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:41.098 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:08:41.098 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:43.246 7fd13f375180 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:08:45.097 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:45.100 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:45.100 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:45.101 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:45.101 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:45.101 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:45.101 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:45.102 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:45.103 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:45.103 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:45.103 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:45.104 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:45.104 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:08:45.104 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:49.101 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:49.102 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:49.102 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:49.102 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:49.102 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:49.103 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:49.103 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:49.103 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:49.103 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:49.103 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:49.103 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:49.103 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:49.103 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:08:49.103 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:53.105 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:53.106 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:53.106 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:53.106 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:53.106 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:53.106 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:53.106 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:53.107 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:53.107 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:53.107 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:53.107 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:53.107 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:53.108 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:08:53.108 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:55.915 7fd13f375180 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:08:57.107 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:08:57.109 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:08:57.109 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:08:57.110 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:57.110 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:08:57.110 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:08:57.110 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:08:57.111 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:08:57.111 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:57.111 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:08:57.111 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:57.112 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:08:57.112 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:08:57.112 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:01.111 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:01.112 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:01.113 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:01.113 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:01.113 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:01.113 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:01.113 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:01.113 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:01.114 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:01.114 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:01.114 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:01.114 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:01.114 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:09:01.114 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:05.115 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:05.118 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:05.119 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:05.119 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:05.120 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:05.121 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:05.121 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:05.122 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:05.122 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:05.123 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:05.123 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:05.123 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:05.123 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:09:05.123 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:09.040 7fd13f375180 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:09:09.119 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:09.121 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:09.122 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:09.123 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:09.123 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:09.124 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:09.124 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:09.125 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:09.126 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:09.126 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:09.126 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:09.127 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:09.127 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:09:09.127 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:13.123 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:13.126 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:13.126 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:13.127 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:13.127 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:13.127 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:13.127 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:13.128 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:13.128 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:13.129 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:13.129 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:13.129 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:13.130 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:09:13.130 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:17.128 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:17.131 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:17.131 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:17.132 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:17.132 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:17.132 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:17.132 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:17.133 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:17.134 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:17.134 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:17.134 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:17.135 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:17.135 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:09:17.135 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:21.131 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:21.133 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:21.133 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:21.133 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:21.134 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:21.134 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:21.134 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:21.134 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:21.134 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:21.135 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:21.135 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:21.135 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:21.135 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:09:21.135 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:21.842 7fd13f375180 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:09:25.135 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:25.137 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:25.137 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:25.137 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:25.138 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:25.138 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:25.138 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:25.139 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:25.139 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:25.140 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:25.140 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:25.140 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:25.140 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:09:25.141 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:29.139 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:29.141 7fd13f375180 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:29.142 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:29.142 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:29.142 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:29.143 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:29.143 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:29.144 7fd13f375180 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:29.144 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:29.144 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:29.144 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:29.145 7fd13f375180 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:29.145 7fd13f375180 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:09:29.145 7fd13f375180 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:33.143 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:33.144 7fd13f375ea0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:33.144 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:33.144 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:33.144 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:33.144 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:33.145 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:33.145 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:33.145 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:33.145 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:33.145 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:33.145 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:33.145 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:09:33.146 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:34.786 7fd13f375ea0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:09:37.145 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:37.146 7fd13f375ea0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:37.147 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:37.147 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:37.147 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:37.147 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:37.147 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:37.147 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:37.147 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:37.148 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:37.148 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:37.148 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:37.148 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:09:37.148 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:41.147 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:41.149 7fd13f375ea0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:41.150 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:41.150 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:41.151 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:41.151 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:41.151 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:41.152 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:41.152 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:41.152 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:41.152 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:41.153 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:41.153 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:09:41.153 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:45.150 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:45.152 7fd13f375ea0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:45.153 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:45.153 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:45.153 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:45.154 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:45.154 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:45.155 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:45.155 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:45.155 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:45.156 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:45.156 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:45.156 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:09:45.156 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:47.772 7fd13f375ea0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:09:49.153 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:49.155 7fd13f375ea0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:49.155 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:49.155 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:49.155 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:49.155 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:49.155 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:49.156 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:49.156 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:49.156 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:49.156 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:49.156 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:49.156 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:09:49.156 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:53.157 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:53.159 7fd13f375ea0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:53.159 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:53.160 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:53.160 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:53.160 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:53.160 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:53.161 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:53.162 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:53.162 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:53.162 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:53.162 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:53.163 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:09:53.163 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:57.160 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:09:57.162 7fd13f375ea0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:09:57.162 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:09:57.163 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:57.163 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:09:57.163 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:09:57.163 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:09:57.164 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:09:57.164 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:57.165 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:09:57.165 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:57.165 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:09:57.166 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:09:57.166 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:00.339 7fd13f375ea0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:10:01.163 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:01.165 7fd13f375ea0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:01.165 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:01.165 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:01.165 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:01.165 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:01.165 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:01.166 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:01.166 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:01.166 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:01.166 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:01.166 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:01.166 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:10:01.166 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:05.167 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:05.168 7fd13f375ea0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:05.168 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:05.168 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:05.169 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:05.169 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:05.169 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:05.169 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:05.169 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:05.169 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:05.169 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:05.169 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:05.169 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:10:05.169 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:09.170 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:09.171 7fd13f375ea0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:09.172 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:09.172 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:09.172 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:09.173 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:09.173 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:09.174 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:09.174 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:09.174 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:09.174 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:09.174 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:09.175 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:10:09.175 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:13.173 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:13.174 7fd13f375ea0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:13.175 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:13.175 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:13.175 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:13.175 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:13.175 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:13.175 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:13.176 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:13.176 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:13.176 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:13.176 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:13.176 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:10:13.176 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:13.352 7fd13f375ea0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:10:17.177 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:17.180 7fd13f375ea0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:17.181 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:17.181 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:17.181 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:17.182 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:17.182 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:17.183 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:17.183 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:17.183 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:17.184 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:17.184 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:17.184 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:10:17.184 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:21.181 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:21.182 7fd13f375ea0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:21.182 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:21.182 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:21.183 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:21.183 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:21.183 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:21.183 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:21.183 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:21.183 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:21.183 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:21.183 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:21.183 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:10:21.184 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:25.184 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:25.185 7fd13f375ea0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:25.185 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:25.186 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:25.186 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:25.186 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:25.186 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:25.186 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:25.186 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:25.187 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:25.187 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:25.187 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:25.187 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:10:25.187 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:26.106 7fd13f375ea0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:10:29.186 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:29.189 7fd13f375ea0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:29.189 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:29.190 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:29.190 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:29.191 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:29.191 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:29.192 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:29.192 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:29.193 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:29.193 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:29.193 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:29.193 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:10:29.194 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:33.189 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:33.191 7fd13f375ea0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:33.191 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:33.191 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:33.191 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:33.192 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:33.192 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:33.192 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:33.192 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:33.192 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:33.193 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:33.193 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:33.193 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:10:33.193 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:37.193 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:37.196 7fd13f375ea0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:37.196 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:37.197 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:37.197 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:37.198 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:37.198 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:37.199 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:37.199 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:37.200 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:37.200 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:37.200 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:37.201 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:10:37.201 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:39.131 7fd13f375ea0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:10:41.196 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:41.199 7fd13f375ea0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:41.200 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:41.200 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:41.200 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:41.201 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:41.201 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:41.202 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:41.202 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:41.203 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:41.203 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:41.203 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:41.204 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:10:41.204 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:45.200 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:45.202 7fd13f375ea0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:45.202 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:45.203 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:45.203 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:45.203 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:45.203 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:45.204 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:45.204 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:45.204 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:45.204 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:45.205 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:45.205 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:10:45.205 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:49.204 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:49.206 7fd13f375ea0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:49.206 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:49.206 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:49.206 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:49.207 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:49.207 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:49.207 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:49.207 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:49.208 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:49.208 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:49.208 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:49.208 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:10:49.208 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:52.079 7fd13f375ea0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:10:53.208 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:53.211 7fd13f375ea0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:53.211 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:53.211 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:53.212 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:53.212 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:53.213 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:53.214 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:53.214 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:53.215 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:53.215 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:53.215 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:53.216 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:10:53.216 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:57.212 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:10:57.214 7fd13f375ea0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:10:57.214 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:10:57.214 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:57.215 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:10:57.215 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:10:57.215 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:10:57.216 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:10:57.217 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:57.217 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:10:57.218 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:57.218 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:10:57.218 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:10:57.218 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:01.214 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:01.218 7fd13f375ea0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:01.218 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:01.218 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:01.218 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:01.219 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:01.219 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:01.219 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:01.219 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:01.220 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:01.220 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:01.220 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:01.220 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:11:01.220 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:04.885 7fd13f375ea0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:11:05.218 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:05.220 7fd13f375ea0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:05.220 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:05.220 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:05.221 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:05.221 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:05.221 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:05.221 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:05.221 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:05.221 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:05.221 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:05.222 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:05.222 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:11:05.223 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:09.222 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:09.224 7fd13f375ea0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:09.224 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:09.224 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:09.225 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:09.225 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:09.225 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:09.226 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:09.226 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:09.226 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:09.227 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:09.227 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:09.227 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:11:09.227 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:13.224 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:13.226 7fd13f375ea0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:13.227 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:13.227 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:13.227 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:13.228 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:13.228 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:13.229 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:13.229 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:13.229 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:13.229 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:13.230 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:13.230 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:11:13.230 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:17.229 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:17.230 7fd13f375ea0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:17.231 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:17.231 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:17.231 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:17.231 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:17.231 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:17.231 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:17.231 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:17.232 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:17.232 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:17.232 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:17.232 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:11:17.232 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:18.111 7fd13f375ea0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:11:21.232 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:21.234 7fd13f375ea0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:21.234 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:21.235 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:21.235 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:21.235 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:21.235 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:21.236 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:21.236 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:21.237 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:21.237 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:21.237 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:21.237 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:11:21.238 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:25.236 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:25.239 7fd13f375ea0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:25.239 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:25.239 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:25.240 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:25.240 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:25.240 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:25.241 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:25.241 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:25.242 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:25.242 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:25.242 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:25.242 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:11:25.243 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:29.241 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:29.245 7fd13f375ea0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:29.245 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:29.245 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:29.245 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:29.246 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:29.246 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:29.246 7fd13f375ea0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:29.246 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:29.247 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:29.247 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:29.247 7fd13f375ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:29.247 7fd13f375ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:11:29.247 7fd13f375ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:31.004 7fd13ef05cc0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:11:33.246 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:33.248 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:33.248 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:33.248 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:33.249 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:33.249 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:33.249 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:33.250 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:33.251 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:33.251 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:33.251 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:33.252 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:33.252 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:11:33.252 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:37.250 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:37.252 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:37.252 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:37.252 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:37.253 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:37.253 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:37.253 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:37.254 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:37.255 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:37.255 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:37.255 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:37.255 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:37.255 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:11:37.256 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:41.254 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:41.255 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:41.255 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:41.255 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:41.256 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:41.256 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:41.256 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:41.256 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:41.256 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:41.256 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:41.256 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:41.256 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:41.257 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:11:41.257 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:43.925 7fd13ef05cc0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:11:45.256 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:45.259 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:45.259 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:45.259 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:45.260 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:45.260 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:45.260 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:45.261 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:45.261 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:45.262 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:45.262 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:45.262 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:45.262 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:11:45.262 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:49.261 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:49.263 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:49.264 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:49.264 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:49.264 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:49.264 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:49.265 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:49.265 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:49.266 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:49.266 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:49.266 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:49.266 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:49.267 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:11:49.267 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:53.264 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:53.266 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:53.266 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:53.267 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:53.267 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:53.267 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:53.268 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:53.268 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:53.269 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:53.269 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:53.269 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:53.270 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:53.270 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:11:53.270 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:56.892 7fd13ef05cc0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:11:57.267 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:11:57.269 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:11:57.269 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:11:57.270 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:57.270 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:11:57.270 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:11:57.270 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:11:57.271 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:11:57.272 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:57.272 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:11:57.272 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:57.273 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:11:57.273 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:11:57.273 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:01.271 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:01.272 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:01.272 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:01.272 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:01.273 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:01.273 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:01.273 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:01.273 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:01.273 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:01.273 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:01.273 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:01.273 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:01.274 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:12:01.274 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:05.273 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:05.275 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:05.276 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:05.276 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:05.276 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:05.277 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:05.277 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:05.278 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:05.278 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:05.279 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:05.279 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:05.279 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:05.279 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:12:05.279 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:09.277 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:09.278 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:09.278 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:09.278 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:09.278 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:09.278 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:09.278 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:09.279 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:09.279 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:09.279 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:09.279 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:09.279 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:09.279 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:12:09.279 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:09.763 7fd13ef05cc0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:12:13.279 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:13.281 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:13.282 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:13.282 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:13.282 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:13.282 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:13.282 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:13.282 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:13.283 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:13.283 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:13.283 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:13.283 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:13.283 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:12:13.283 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:17.285 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:17.287 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:17.287 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:17.287 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:17.288 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:17.288 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:17.288 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:17.289 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:17.289 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:17.289 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:17.289 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:17.290 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:17.290 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:12:17.290 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:21.288 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:21.290 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:21.291 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:21.291 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:21.291 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:21.292 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:21.292 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:21.292 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:21.293 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:21.293 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:21.293 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:21.293 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:21.294 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:12:21.294 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:22.909 7fd13ef05cc0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:12:25.292 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:25.295 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:25.295 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:25.295 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:25.296 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:25.296 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:25.296 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:25.297 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:25.298 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:25.298 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:25.298 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:25.298 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:25.299 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:12:25.299 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:29.298 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:29.300 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:29.301 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:29.301 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:29.302 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:29.302 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:29.302 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:29.303 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:29.303 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:29.304 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:29.304 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:29.304 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:29.305 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:12:29.305 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:33.302 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:33.304 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:33.304 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:33.304 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:33.305 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:33.305 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:33.305 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:33.306 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:33.306 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:33.307 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:33.307 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:33.307 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:33.307 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:12:33.308 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:35.668 7fd13ef05cc0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:12:37.306 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:37.308 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:37.308 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:37.308 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:37.309 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:37.309 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:37.309 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:37.310 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:37.310 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:37.311 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:37.311 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:37.311 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:37.312 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:12:37.312 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:41.310 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:41.312 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:41.312 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:41.312 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:41.313 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:41.313 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:41.313 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:41.314 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:41.314 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:41.314 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:41.315 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:41.315 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:41.315 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:12:41.316 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:45.312 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:45.315 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:45.315 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:45.315 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:45.316 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:45.316 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:45.316 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:45.317 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:45.317 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:45.318 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:45.318 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:45.318 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:45.318 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:12:45.319 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:48.699 7fd13ef05cc0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:12:49.316 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:49.318 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:49.319 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:49.319 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:49.319 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:49.320 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:49.320 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:49.321 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:49.321 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:49.321 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:49.322 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:49.322 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:49.322 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:12:49.322 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:53.321 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:53.324 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:53.324 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:53.325 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:53.326 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:53.326 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:53.326 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:53.327 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:53.328 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:53.328 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:53.328 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:53.328 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:53.329 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:12:53.329 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:57.325 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:12:57.327 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:12:57.327 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:12:57.327 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:57.328 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:12:57.328 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:12:57.328 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:12:57.329 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:12:57.329 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:57.329 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:12:57.329 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:57.329 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:12:57.329 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:12:57.329 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:01.329 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:01.330 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:01.330 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:01.330 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:01.331 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:01.331 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:01.331 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:01.331 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:01.331 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:01.331 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:01.331 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:01.331 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:01.331 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:13:01.331 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:01.621 7fd13ef05cc0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:13:05.334 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:05.336 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:05.337 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:05.337 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:05.338 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:05.338 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:05.338 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:05.340 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:05.340 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:05.340 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:05.341 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:05.341 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:05.341 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:13:05.341 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:09.338 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:09.339 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:09.339 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:09.340 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:09.340 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:09.340 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:09.340 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:09.340 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:09.341 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:09.341 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:09.341 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:09.341 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:09.341 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:13:09.341 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:13.341 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:13.342 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:13.342 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:13.342 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:13.342 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:13.342 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:13.342 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:13.343 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:13.343 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:13.343 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:13.343 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:13.343 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:13.343 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:13:13.343 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:14.514 7fd13ef05cc0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:13:17.345 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:17.347 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:17.348 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:17.348 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:17.348 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:17.349 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:17.349 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:17.350 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:17.350 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:17.350 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:17.351 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:17.351 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:17.351 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:13:17.351 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:21.348 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:21.351 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:21.352 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:21.352 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:21.352 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:21.353 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:21.353 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:21.354 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:21.355 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:21.355 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:21.355 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:21.356 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:21.356 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:13:21.356 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:25.351 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:25.353 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:25.354 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:25.354 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:25.354 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:25.355 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:25.355 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:25.356 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:25.356 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:25.356 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:25.356 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:25.357 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:25.357 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:13:25.357 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:27.867 7fd13ef05cc0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:13:29.356 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:29.358 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:29.359 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:29.359 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:29.359 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:29.359 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:29.360 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:29.360 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:29.361 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:29.361 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:29.361 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:29.362 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:29.362 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:13:29.362 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:33.360 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:33.361 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:33.362 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:33.362 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:33.362 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:33.362 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:33.362 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:33.363 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:33.363 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:33.364 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:33.364 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:33.364 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:33.364 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:13:33.364 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:37.363 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:37.365 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:37.365 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:37.365 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:37.366 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:37.366 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:37.366 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:37.366 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:37.366 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:37.367 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:37.367 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:37.367 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:37.367 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:13:37.367 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:40.733 7fd13ef05cc0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:13:41.367 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:41.369 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:41.370 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:41.370 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:41.370 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:41.371 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:41.371 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:41.372 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:41.372 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:41.372 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:41.372 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:41.373 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:41.373 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:13:41.373 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:45.370 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:45.372 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:45.372 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:45.372 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:45.372 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:45.372 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:45.372 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:45.373 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:45.373 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:45.373 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:45.373 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:45.374 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:45.374 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:13:45.374 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:49.373 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:49.376 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:49.376 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:49.376 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:49.376 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:49.377 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:49.377 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:49.378 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:49.378 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:49.378 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:49.378 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:49.379 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:49.379 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:13:49.379 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:53.377 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:53.379 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:53.379 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:53.379 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:53.380 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:53.380 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:53.380 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:53.380 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:53.381 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:53.381 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:53.381 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:53.381 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:53.381 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:13:53.381 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:53.466 7fd13ef05cc0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:13:57.380 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:13:57.381 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:13:57.381 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:13:57.382 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:57.382 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:13:57.382 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:13:57.382 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:13:57.382 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:13:57.382 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:57.382 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:13:57.382 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:57.382 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:13:57.383 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:13:57.383 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:01.384 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:01.385 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:01.385 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:01.385 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:01.385 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:01.385 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:01.386 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:01.386 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:01.386 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:01.386 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:01.386 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:01.386 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:01.386 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:14:01.386 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:05.386 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:05.388 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:05.388 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:05.388 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:05.389 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:05.389 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:05.389 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:05.390 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:05.390 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:05.391 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:05.391 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:05.391 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:05.392 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:14:05.392 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:06.200 7fd13ef05cc0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:14:09.388 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:09.389 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:09.389 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:09.390 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:09.390 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:09.390 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:09.390 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:09.390 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:09.390 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:09.390 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:09.391 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:09.391 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:09.391 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:14:09.391 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:13.391 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:13.392 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:13.392 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:13.392 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:13.393 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:13.393 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:13.393 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:13.393 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:13.393 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:13.393 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:13.393 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:13.394 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:13.394 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:14:13.394 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:17.394 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:17.396 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:17.397 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:17.397 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:17.397 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:17.398 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:17.398 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:17.399 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:17.399 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:17.400 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:17.400 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:17.400 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:17.401 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:14:17.401 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:19.083 7fd13ef05cc0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:14:21.398 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:21.400 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:21.400 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:21.400 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:21.401 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:21.401 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:21.401 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:21.402 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:21.402 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:21.402 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:21.403 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:21.403 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:21.403 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:14:21.403 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:25.402 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:25.404 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:25.404 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:25.405 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:25.405 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:25.405 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:25.405 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:25.405 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:25.405 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:25.405 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:25.405 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:25.405 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:25.405 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:14:25.406 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:29.405 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:29.407 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:29.408 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:29.408 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:29.409 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:29.409 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:29.409 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:29.410 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:29.411 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:29.411 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:29.412 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:29.412 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:29.412 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:14:29.412 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:32.156 7fd13ef05cc0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:14:33.409 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:33.411 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:33.412 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:33.412 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:33.412 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:33.413 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:33.413 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:33.414 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:33.414 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:33.415 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:33.415 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:33.415 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:33.415 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:14:33.416 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:37.414 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:37.416 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:37.416 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:37.416 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:37.416 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:37.417 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:37.417 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:37.418 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:37.418 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:37.418 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:37.418 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:37.419 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:37.419 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:14:37.419 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:41.419 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:41.421 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:41.421 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:41.421 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:41.422 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:41.422 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:41.422 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:41.423 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:41.423 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:41.424 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:41.424 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:41.424 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:41.425 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:14:41.425 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:45.009 7fd13ef05cc0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:14:45.421 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:45.423 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:45.423 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:45.423 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:45.423 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:45.423 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:45.423 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:45.423 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:45.424 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:45.424 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:45.424 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:45.424 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:45.424 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:14:45.424 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:49.425 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:49.428 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:49.428 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:49.429 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:49.429 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:49.430 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:49.430 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:49.431 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:49.431 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:49.432 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:49.432 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:49.432 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:49.433 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:14:49.433 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:53.429 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:53.431 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:53.431 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:53.431 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:53.432 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:53.432 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:53.432 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:53.433 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:53.433 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:53.433 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:53.433 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:53.434 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:53.434 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:14:53.434 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:57.431 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:14:57.433 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:14:57.433 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:14:57.433 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:57.434 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:14:57.434 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:14:57.434 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:14:57.434 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:14:57.434 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:57.435 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:14:57.435 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:57.435 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:57.435 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:14:57.435 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:14:57.969 7fd13ef05cc0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:15:01.435 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:15:01.437 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:15:01.437 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:15:01.437 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:01.437 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:15:01.437 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:01.437 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:15:01.438 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:15:01.438 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:01.438 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:15:01.438 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:01.438 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:01.438 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:15:01.438 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:05.440 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:15:05.442 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:15:05.442 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:15:05.442 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:05.442 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:15:05.442 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:05.443 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:15:05.443 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:15:05.443 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:05.443 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:15:05.444 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:05.444 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:05.444 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:15:05.444 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:09.442 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:15:09.444 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:15:09.444 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:15:09.444 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:09.444 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:15:09.444 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:09.444 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:15:09.445 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:15:09.445 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:09.445 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:15:09.445 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:09.445 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:09.445 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:15:09.446 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:11.041 7fd13ef05cc0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:15:13.446 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:15:13.448 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:15:13.448 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:15:13.448 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:13.449 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:15:13.449 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:13.449 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:15:13.450 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:15:13.451 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:13.451 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:15:13.451 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:13.451 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:13.452 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:15:13.452 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:17.450 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:15:17.451 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:15:17.451 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:15:17.451 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:17.451 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:15:17.451 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:17.451 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:15:17.452 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:15:17.452 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:17.452 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:15:17.452 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:17.452 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:17.452 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:15:17.452 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:21.452 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:15:21.453 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:15:21.453 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:15:21.453 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:21.453 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:15:21.453 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:21.454 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:15:21.454 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:15:21.454 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:21.454 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:15:21.454 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:21.454 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:21.454 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:15:21.454 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:23.855 7fd13ef05cc0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:15:25.456 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:15:25.458 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:15:25.458 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:15:25.458 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:25.459 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:15:25.459 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:25.459 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:15:25.460 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:15:25.460 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:25.461 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:15:25.461 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:25.461 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:25.461 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:15:25.462 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:29.461 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:15:29.463 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:15:29.463 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:15:29.464 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:29.464 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:15:29.464 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:29.465 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:15:29.466 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:15:29.466 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:29.466 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:15:29.467 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:29.467 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:29.467 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:15:29.468 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:33.464 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:15:33.466 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:15:33.466 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:15:33.467 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:33.467 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:15:33.467 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:33.467 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:15:33.468 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:15:33.468 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:33.469 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:15:33.469 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:33.469 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:33.470 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:15:33.470 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:37.124 7fd13ef05cc0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:15:37.467 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:15:37.468 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:15:37.468 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:15:37.469 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:37.469 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:15:37.469 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:37.469 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:15:37.469 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:15:37.470 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:37.470 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:15:37.470 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:37.470 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:37.470 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:15:37.470 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:39.881 7fd13ef05cc0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:15:41.469 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:15:41.470 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:15:41.471 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:15:41.471 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:41.471 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:15:41.471 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:41.471 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:15:41.471 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:15:41.471 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:41.472 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:15:41.472 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:41.472 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:41.472 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:15:41.472 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:42.785 7fd13ef05cc0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:15:45.472 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:15:45.474 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:15:45.475 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:15:45.475 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:45.475 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:15:45.476 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:45.476 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:15:45.476 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:15:45.477 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:45.477 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:15:45.477 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:45.477 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:45.478 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:15:45.478 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:49.476 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:15:49.478 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:15:49.478 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:15:49.479 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:49.479 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:15:49.479 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:49.479 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:15:49.480 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:15:49.480 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:49.481 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:15:49.481 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:49.481 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:49.482 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:15:49.482 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:53.480 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:15:53.484 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:15:53.484 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:15:53.485 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:53.485 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:15:53.486 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:53.486 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:15:53.487 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:15:53.487 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:53.488 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:15:53.488 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:53.488 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:53.488 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:15:53.488 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:57.484 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:15:57.486 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:15:57.487 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:15:57.487 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:57.487 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:15:57.488 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:15:57.488 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:15:57.489 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:15:57.489 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:57.489 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:15:57.490 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:57.490 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:15:57.490 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:15:57.490 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:01.488 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:16:01.490 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:16:01.491 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:16:01.491 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:01.491 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:16:01.492 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:01.492 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:16:01.493 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:16:01.493 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:01.494 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:16:01.494 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:01.494 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:01.494 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:16:01.495 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:05.493 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:16:05.496 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:16:05.496 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:16:05.496 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:05.497 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:16:05.497 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:05.497 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:16:05.498 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:16:05.499 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:05.499 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:16:05.499 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:05.499 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:05.500 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:16:05.500 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:09.496 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:16:09.499 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:16:09.499 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:16:09.499 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:09.500 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:16:09.500 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:09.500 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:16:09.501 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:16:09.501 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:09.502 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:16:09.502 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:09.502 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:09.502 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:16:09.502 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:13.501 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:16:13.503 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:16:13.503 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:16:13.503 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:13.504 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:16:13.504 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:13.504 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:16:13.505 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:16:13.505 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:13.506 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:16:13.506 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:13.506 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:13.506 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:16:13.507 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:17.131 7fd13ef05cc0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/01/2025 02:16:17.504 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:16:17.506 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:16:17.507 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:16:17.507 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:17.508 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:16:17.508 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:17.508 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:16:17.509 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:16:17.509 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:17.510 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:16:17.510 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:17.510 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:17.511 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:16:17.511 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:21.508 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:16:21.509 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:16:21.509 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:16:21.509 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:21.509 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:16:21.509 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:21.510 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:16:21.510 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:16:21.510 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:21.510 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:16:21.510 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:21.510 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:21.510 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:16:21.510 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:25.510 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:16:25.511 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:16:25.511 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:16:25.511 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:25.512 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:16:25.512 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:25.512 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:16:25.512 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:16:25.512 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:25.512 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:16:25.512 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:25.512 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:25.513 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:16:25.513 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:29.514 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/01/2025 02:16:29.515 7fd13ef05cc0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 09/01/2025 02:16:29.516 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/01/2025 02:16:29.516 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:29.516 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/01/2025 02:16:29.516 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/01/2025 02:16:29.516 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/01/2025 02:16:29.517 7fd13ef05cc0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/01/2025 02:16:29.517 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:29.517 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/01/2025 02:16:29.518 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:29.518 7fd13ef05cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/01/2025 02:16:29.518 7fd13ef05cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3992-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1756691768443132 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/01/2025 02:16:29.518 7fd13ef05cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]