11/03/2025 01:59:45.099 7f2a54470ec0 [contrail-schema] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 11/03/2025 01:59:45.099 7f2a54470ec0 [contrail-schema] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 11/03/2025 01:59:45.099 7f2a54470ec0 [contrail-schema] [INFO]: SANDESH: Flow Logging: [None] -> [False] 11/03/2025 01:59:45.099 7f2a52967220 [contrail-schema] [INFO]: Processing event[EvStart] in state[none] 11/03/2025 01:59:45.099 7f2a52967220 [contrail-schema] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 11/03/2025 01:59:45.100 7f2a52967220 [contrail-schema] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 11/03/2025 01:59:45.100 7f2a52967220 [contrail-schema] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 11/03/2025 01:59:45.100 7f2a52967220 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:59:45.100 7f2a52967220 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 11/03/2025 01:59:45.100 7f2a52967220 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:59:45.100 7f2a52967220 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:59:45.100 7f2a52967220 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 11/03/2025 01:59:45.100 7f2a52967220 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:59:45.196 7f2a54470ec0 [contrail-schema] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.249:5673//', 'pyamqp://guest:guest@10.0.0.61:5673//', 'pyamqp://guest:guest@10.0.0.23:5673//'] 11/03/2025 01:59:45.204 7f2a54470ec0 [contrail-schema] [WARNING]: RabbitMQ drainer connection down 11/03/2025 01:59:45.205 7f2a529d7ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:59:45.205 7f2a529d7ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 11/03/2025 01:59:45.205 7f2a529d7ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:59:45.205 7f2a529d7ea0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:59:45.205 7f2a529d7ea0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 11/03/2025 01:59:45.205 7f2a529d7ea0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:59:45.209 7f2a54470ec0 [contrail-schema] [WARNING]: RabbitMQ drainer connection ESTABLISHED 11/03/2025 01:59:45.209 7f2a52940040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:59:45.209 7f2a52940040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 11/03/2025 01:59:45.209 7f2a52940040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:59:45.255 7f2a54470ec0 [contrail-schema] [WARNING]: RabbitMQ publish connection down 11/03/2025 01:59:45.255 7f2a52940b80 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:59:45.256 7f2a52940b80 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 11/03/2025 01:59:45.256 7f2a52940b80 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:59:45.259 7f2a54470ec0 [contrail-schema] [WARNING]: RabbitMQ publish connection ESTABLISHED 11/03/2025 01:59:45.259 7f2a52940b80 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:59:45.260 7f2a52940b80 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 11/03/2025 01:59:45.260 7f2a52940b80 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:59:45.276 7f2a54470ec0 [contrail-schema] [DEBUG]: Removed remained AMQP queue 11/03/2025 01:59:45.277 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:59:45.278 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Zookeeper:Zookeeper[] connection down >>, ] >> 11/03/2025 01:59:45.278 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:59:45.291 7f2a54470ec0 [contrail-schema] [WARNING]: Waiting to be elected as master... 11/03/2025 01:59:45.292 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:59:45.292 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 11/03/2025 01:59:45.292 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:59:49.102 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 01:59:49.103 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 01:59:49.103 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 01:59:49.103 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 01:59:49.103 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 01:59:49.103 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 01:59:49.103 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 01:59:49.104 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 01:59:49.104 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:59:49.104 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 01:59:49.104 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:59:49.104 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:59:49.104 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 01:59:49.104 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:59:53.105 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 01:59:53.107 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 01:59:53.107 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 01:59:53.107 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 01:59:53.107 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 01:59:53.107 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 01:59:53.107 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 01:59:53.107 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 01:59:53.108 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:59:53.108 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 01:59:53.108 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:59:53.108 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:59:53.108 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 01:59:53.108 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:59:57.110 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 01:59:57.111 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 01:59:57.112 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 01:59:57.112 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 01:59:57.112 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 01:59:57.112 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 01:59:57.112 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 01:59:57.112 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 01:59:57.112 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:59:57.112 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 01:59:57.112 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:59:57.112 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 01:59:57.112 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.61:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 01:59:57.113 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:01.115 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:00:01.116 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 02:00:01.116 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:00:01.117 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:00:01.117 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:00:01.117 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:00:01.117 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 02:00:01.117 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 02:00:01.117 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:01.118 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 02:00:01.118 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:01.118 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:01.118 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:00:01.118 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:05.121 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:00:05.128 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 02:00:05.128 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:00:05.128 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:00:05.129 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:00:05.129 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:00:05.129 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 02:00:05.129 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 02:00:05.129 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:05.129 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 02:00:05.129 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:05.130 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:05.130 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:00:05.130 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:09.133 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:00:09.134 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 02:00:09.137 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:00:09.137 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:00:09.137 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:00:09.137 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:00:09.137 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 02:00:09.137 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 02:00:09.139 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:09.139 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 02:00:09.139 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:09.139 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:09.139 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.61:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:00:09.139 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:13.137 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:00:13.144 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 02:00:13.144 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:00:13.144 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:00:13.144 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:00:13.144 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:00:13.145 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 02:00:13.145 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 02:00:13.145 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:13.145 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 02:00:13.145 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:13.145 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:13.145 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:00:13.145 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:17.148 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:00:17.150 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 02:00:17.150 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:00:17.150 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:00:17.151 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:00:17.151 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:00:17.151 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 02:00:17.151 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 02:00:17.151 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:17.151 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 02:00:17.151 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:17.151 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:17.151 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:00:17.151 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:21.154 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:00:21.155 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 02:00:21.155 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:00:21.155 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:00:21.155 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:00:21.155 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:00:21.155 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 02:00:21.155 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 02:00:21.155 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:21.156 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 02:00:21.156 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:21.156 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:21.156 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.61:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:00:21.156 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:25.157 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:00:25.158 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 02:00:25.158 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:00:25.158 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:00:25.158 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:00:25.158 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:00:25.158 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 02:00:25.159 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 02:00:25.159 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:25.159 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 02:00:25.159 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:25.159 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:25.159 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:00:25.159 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:29.162 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:00:29.163 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 02:00:29.163 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:00:29.163 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:00:29.163 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:00:29.163 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:00:29.163 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 02:00:29.164 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 02:00:29.164 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:29.164 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 02:00:29.164 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:29.164 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:29.164 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:00:29.164 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:33.164 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:00:33.165 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 02:00:33.165 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:00:33.165 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:00:33.165 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:00:33.165 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:00:33.165 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 02:00:33.166 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 02:00:33.166 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:33.166 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 02:00:33.166 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:33.166 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:33.166 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.61:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:00:33.166 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:37.169 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:00:37.170 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 02:00:37.170 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:00:37.171 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:00:37.171 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:00:37.171 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:00:37.171 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 02:00:37.171 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 02:00:37.171 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:37.171 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 02:00:37.171 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:37.171 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:37.171 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:00:37.171 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:41.173 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:00:41.175 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 02:00:41.175 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:00:41.175 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:00:41.175 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:00:41.175 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:00:41.175 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 02:00:41.175 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 02:00:41.175 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:41.176 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 02:00:41.176 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:41.176 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:41.176 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:00:41.176 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:45.178 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:00:45.179 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 02:00:45.179 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:00:45.179 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:00:45.179 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:00:45.179 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:00:45.180 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 02:00:45.180 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 02:00:45.180 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:45.180 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 02:00:45.180 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:45.180 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:45.181 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.61:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:00:45.181 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:49.182 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:00:49.183 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 02:00:49.183 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:00:49.183 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:00:49.183 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:00:49.183 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:00:49.183 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 02:00:49.183 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 02:00:49.183 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:49.183 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 02:00:49.183 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:49.184 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:49.184 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:00:49.184 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:53.186 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:00:53.187 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 02:00:53.187 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:00:53.187 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:00:53.187 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:00:53.187 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:00:53.187 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 02:00:53.187 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 02:00:53.188 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:53.188 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 02:00:53.188 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:53.188 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:53.188 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:00:53.188 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:57.191 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:00:57.193 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 02:00:57.193 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:00:57.193 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:00:57.193 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:00:57.194 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:00:57.194 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 02:00:57.194 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 02:00:57.194 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:57.194 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 02:00:57.195 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:57.195 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:00:57.195 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.61:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:00:57.196 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:01.194 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:01:01.195 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 02:01:01.195 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:01:01.195 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:01:01.195 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:01:01.195 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:01:01.195 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 02:01:01.196 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 02:01:01.196 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:01.196 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 02:01:01.196 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:01.196 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:01.196 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:01:01.196 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:05.195 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:01:05.197 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 02:01:05.197 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:01:05.197 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:01:05.197 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:01:05.197 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:01:05.197 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 02:01:05.197 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 02:01:05.198 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:05.198 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 02:01:05.198 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:05.198 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:05.198 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:01:05.198 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:09.202 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:01:09.203 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 02:01:09.203 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:01:09.203 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:01:09.203 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:01:09.203 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:01:09.203 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 02:01:09.204 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 02:01:09.204 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:09.204 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 02:01:09.204 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:09.204 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:09.204 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.61:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:01:09.204 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:13.206 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:01:13.207 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 02:01:13.207 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:01:13.207 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:01:13.207 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:01:13.207 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:01:13.207 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 02:01:13.208 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 02:01:13.208 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:13.208 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 02:01:13.208 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:13.208 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:13.208 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:01:13.208 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:17.208 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:01:17.209 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 02:01:17.209 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:01:17.209 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:01:17.210 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:01:17.210 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:01:17.210 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 02:01:17.210 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 02:01:17.210 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:17.210 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 02:01:17.210 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:17.210 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:17.210 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:01:17.210 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:21.214 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:01:21.215 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 02:01:21.215 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:01:21.215 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:01:21.215 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:01:21.215 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:01:21.215 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 02:01:21.215 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 02:01:21.215 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:21.216 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 02:01:21.216 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:21.216 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:21.216 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.61:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:01:21.216 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:25.217 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:01:25.218 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 02:01:25.218 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:01:25.219 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:01:25.219 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:01:25.219 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:01:25.219 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 02:01:25.219 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 02:01:25.219 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:25.219 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 02:01:25.219 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:25.219 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:25.219 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:01:25.220 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:29.223 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:01:29.224 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 02:01:29.224 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:01:29.224 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:01:29.224 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:01:29.224 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:01:29.224 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 02:01:29.225 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 02:01:29.225 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:29.225 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 02:01:29.225 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:29.225 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:29.225 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:01:29.225 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:33.225 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:01:33.227 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 02:01:33.227 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:01:33.227 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:01:33.227 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:01:33.227 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:01:33.227 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 02:01:33.228 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 02:01:33.228 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:33.228 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 02:01:33.228 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:33.228 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:33.228 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.61:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:01:33.228 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:37.230 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:01:37.231 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 02:01:37.231 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:01:37.231 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:01:37.231 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:01:37.231 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:01:37.232 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 02:01:37.232 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 02:01:37.232 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:37.232 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 02:01:37.232 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:37.232 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:37.232 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:01:37.232 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:41.235 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:01:41.236 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 02:01:41.236 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:01:41.236 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:01:41.237 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:01:41.237 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:01:41.237 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 02:01:41.237 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 02:01:41.237 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:41.237 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 02:01:41.237 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:41.237 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:41.237 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:01:41.237 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:45.237 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:01:45.239 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 02:01:45.239 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:01:45.239 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:01:45.239 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:01:45.239 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:01:45.239 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 02:01:45.240 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 02:01:45.240 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:45.240 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 02:01:45.240 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:45.240 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:45.240 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.61:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:01:45.240 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:49.241 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:01:49.242 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 02:01:49.242 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:01:49.242 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:01:49.243 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:01:49.243 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:01:49.243 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 02:01:49.243 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 02:01:49.243 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:49.243 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 02:01:49.243 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:49.243 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:49.243 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:01:49.243 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:53.246 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:01:53.247 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 02:01:53.247 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:01:53.247 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:01:53.247 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:01:53.247 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:01:53.247 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 02:01:53.248 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 02:01:53.248 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:53.248 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 02:01:53.248 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:53.248 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:53.248 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:01:53.248 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:57.248 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:01:57.250 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 02:01:57.250 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:01:57.250 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:01:57.250 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:01:57.250 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:01:57.250 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 02:01:57.251 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 02:01:57.251 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:57.251 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 02:01:57.251 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:57.251 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:01:57.251 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.61:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:01:57.251 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:02:01.254 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:02:01.254 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 02:02:01.255 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:02:01.255 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:02:01.255 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:02:01.255 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:02:01.255 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 02:02:01.255 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 02:02:01.255 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:02:01.255 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 02:02:01.255 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:02:01.255 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:02:01.255 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:02:01.255 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:02:05.257 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:02:05.259 7f2a53709040 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 11/03/2025 02:02:05.259 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:02:05.259 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:02:05.259 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:02:05.259 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:02:05.259 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/03/2025 02:02:05.260 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/03/2025 02:02:05.260 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:02:05.260 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/03/2025 02:02:05.260 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:02:05.260 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:02:05.260 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:02:05.260 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:02:09.260 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:02:09.261 7f2a53709040 [contrail-schema] [INFO]: Session Event: TCP Connected 11/03/2025 02:02:09.261 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:02:09.262 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:02:09.262 7f2a53709040 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:02:09.262 7f2a53709040 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:02:09.262 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvTcpConnected] in state[Connect] 11/03/2025 02:02:09.262 7f2a53709040 [contrail-schema] [DEBUG]: Send sandesh control message. uve type count # 19 11/03/2025 02:02:09.262 7f2a53709040 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 11/03/2025 02:02:09.262 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 11/03/2025 02:02:09.262 7f2a53709040 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 11/03/2025 02:02:09.262 7f2a53709400 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 11/03/2025 02:02:09.263 7f2a53709400 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 11/03/2025 02:02:18.811 7f2a537092c0 [contrail-schema] [ERROR]: Session Event: TCP Connection Closed 11/03/2025 02:02:18.811 7f2a51a53860 [contrail-schema] [INFO]: Processing event[EvTcpClose] in state[ClientInit] 11/03/2025 02:02:18.811 7f2a51a53860 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle] 11/03/2025 02:02:18.811 7f2a51a53860 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:02:18.811 7f2a51a53860 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Down description = ClientInit to Idle on EvTcpClose >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[ClientInit to Idle on EvTcpClose] connection down >>, ] >> 11/03/2025 02:02:18.811 7f2a51a53860 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:02:18.812 7f2a51a53860 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:02:18.812 7f2a51a53860 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 1 pid = 1 start_time = 1762135185100066 collector_name = collector_ip = 10.0.0.61:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.249:8086, 10.0.0.61:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/03/2025 02:02:18.812 7f2a51a53860 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/03/2025 02:02:22.813 7f2a51a53860 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/03/2025 02:02:22.814 7f2a51a53860 [contrail-schema] [INFO]: Session Event: TCP Connected 11/03/2025 02:02:22.814 7f2a51a53860 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/03/2025 02:02:22.814 7f2a51a53860 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:02:22.815 7f2a51a53860 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4597-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.61:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.61:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/03/2025 02:02:22.815 7f2a51a53860 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/03/2025 02:02:22.815 7f2a51a53860 [contrail-schema] [INFO]: Processing event[EvTcpConnected] in state[Connect] 11/03/2025 02:02:22.815 7f2a51a53860 [contrail-schema] [DEBUG]: Send sandesh control message. uve type count # 19 11/03/2025 02:02:22.815 7f2a51a53860 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 11/03/2025 02:02:22.815 7f2a51a53860 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 11/03/2025 02:02:22.815 7f2a51a53860 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 11/03/2025 02:02:22.815 7f2a53709040 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 11/03/2025 02:02:22.816 7f2a53709040 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 11/03/2025 02:02:22.818 7f2a53709400 [contrail-schema] [DEBUG]: Extracted sandesh length: 0000001017 11/03/2025 02:02:22.818 7f2a53709400 [contrail-schema] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 11/03/2025 02:02:22.818 7f2a51a53860 [contrail-schema] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 11/03/2025 02:02:22.819 7f2a51a53860 [contrail-schema] [DEBUG]: Number of uve types in sandesh control message is 0 11/03/2025 02:02:22.819 7f2a51a53860 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/03/2025 02:02:22.819 7f2a51a53860 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 11/03/2025 02:02:22.819 7f2a51a53860 [contrail-schema] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 11/03/2025 02:02:22.819 7f2a52967360 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 11/03/2025 02:02:22.820 7f2a52967360 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 11/03/2025 02:02:30.387 7f2a53709400 [contrail-schema] [DEBUG]: Extracted sandesh length: 0000001296 11/03/2025 02:02:30.388 7f2a53709400 [contrail-schema] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 11/03/2025 02:02:30.388 7f2a52967400 [contrail-schema] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 11/03/2025 02:02:30.388 7f2a52967400 [contrail-schema] [DEBUG]: Number of uve types in sandesh control message is 2 11/03/2025 02:02:30.388 7f2a52967400 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/03/2025 02:02:30.388 7f2a52967400 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map