01/20/2025 00:47:56.264 7f97989f9448 [contrail-schema] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 01/20/2025 00:47:56.264 7f97989f9448 [contrail-schema] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 01/20/2025 00:47:56.264 7f97989f9448 [contrail-schema] [INFO]: SANDESH: Flow Logging: [None] -> [False] 01/20/2025 00:47:56.265 7f97927b70f0 [contrail-schema] [INFO]: Processing event[EvStart] in state[none] 01/20/2025 00:47:56.265 7f97927b70f0 [contrail-schema] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 01/20/2025 00:47:56.273 7f97927b70f0 [contrail-schema] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 00:47:56.273 7f97927b70f0 [contrail-schema] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 01/20/2025 00:47:56.273 7f97927b70f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:47:56.273 7f97927b70f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 00:47:56.273 7f97927b70f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:47:56.273 7f97927b70f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:47:56.274 7f97927b70f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 01/20/2025 00:47:56.274 7f97927b70f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:47:56.428 7f97989f9448 [contrail-schema] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.42:5673//', 'pyamqp://guest:guest@10.0.0.22:5673//', 'pyamqp://guest:guest@10.0.0.49:5673//'] 01/20/2025 00:47:56.440 7f97989f9448 [contrail-schema] [WARNING]: RabbitMQ drainer connection down 01/20/2025 00:47:56.441 7f9792255630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:47:56.441 7f9792255630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/20/2025 00:47:56.441 7f9792255630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:47:56.441 7f9792255630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:47:56.442 7f9792255630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/20/2025 00:47:56.442 7f9792255630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:47:56.444 7f97989f9448 [contrail-schema] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/20/2025 00:47:56.444 7f97922e8f60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:47:56.445 7f97922e8f60 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 00:47:56.445 7f97922e8f60 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:47:56.522 7f97989f9448 [contrail-schema] [WARNING]: RabbitMQ publish connection down 01/20/2025 00:47:56.523 7f97922e8eb8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:47:56.523 7f97922e8eb8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/20/2025 00:47:56.524 7f97922e8eb8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:47:56.527 7f97989f9448 [contrail-schema] [WARNING]: RabbitMQ publish connection ESTABLISHED 01/20/2025 00:47:56.528 7f979eea5978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:47:56.528 7f979eea5978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 00:47:56.528 7f979eea5978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:47:56.561 7f97989f9448 [contrail-schema] [DEBUG]: Removed remained AMQP queue 01/20/2025 00:47:56.563 7f97922718d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:47:56.563 7f97922718d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Zookeeper:Zookeeper[] connection down >>, ] >> 01/20/2025 00:47:56.563 7f97922718d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:47:56.575 7f97989f9448 [contrail-schema] [WARNING]: Waiting to be elected as master... 01/20/2025 00:47:56.576 7f97923dfe10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:47:56.576 7f97923dfe10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 00:47:56.576 7f97923dfe10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:00.268 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:48:00.269 7f97923dfd68 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:48:00.269 7f97923dfd68 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:48:00.269 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:48:00.269 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:48:00.269 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:48:00.270 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:48:00.270 7f97923dfd68 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:48:00.270 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:00.270 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:48:00.270 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:00.270 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:00.270 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:48:00.270 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:04.271 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:48:04.273 7f97923dfd68 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:48:04.273 7f97923dfd68 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:48:04.274 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:48:04.274 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:48:04.274 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:48:04.274 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:48:04.274 7f97923dfd68 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:48:04.274 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:04.275 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:48:04.275 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:04.275 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:04.275 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:48:04.275 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:08.276 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:48:08.277 7f97923dfd68 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:48:08.277 7f97923dfd68 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:48:08.277 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:48:08.278 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:48:08.278 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:48:08.278 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:48:08.278 7f97923dfd68 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:48:08.278 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:08.278 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:48:08.279 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:08.279 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:08.279 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:48:08.279 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:12.280 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:48:12.283 7f97923dfd68 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:48:12.283 7f97923dfd68 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:48:12.283 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:48:12.283 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:48:12.283 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:48:12.283 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:48:12.284 7f97923dfd68 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:48:12.284 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:12.284 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:48:12.284 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:12.284 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:12.284 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:48:12.284 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:16.284 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:48:16.285 7f97923dfd68 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:48:16.286 7f97923dfd68 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:48:16.286 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:48:16.286 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:48:16.286 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:48:16.286 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:48:16.287 7f97923dfd68 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:48:16.287 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:16.287 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:48:16.287 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:16.287 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:16.287 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:48:16.287 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:20.287 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:48:20.290 7f97923dfd68 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:48:20.290 7f97923dfd68 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:48:20.290 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:48:20.290 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:48:20.290 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:48:20.290 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:48:20.291 7f97923dfd68 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:48:20.291 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:20.291 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:48:20.291 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:20.291 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:20.291 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:48:20.291 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:24.296 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:48:24.297 7f97923dfd68 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:48:24.297 7f97923dfd68 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:48:24.297 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:48:24.297 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:48:24.297 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:48:24.297 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:48:24.297 7f97923dfd68 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:48:24.297 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:24.297 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:48:24.298 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:24.298 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:24.298 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:48:24.298 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:28.300 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:48:28.304 7f97923dfd68 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:48:28.304 7f97923dfd68 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:48:28.304 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:48:28.304 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:48:28.304 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:48:28.305 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:48:28.305 7f97923dfd68 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:48:28.305 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:28.305 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:48:28.305 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:28.305 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:28.305 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:48:28.305 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:32.309 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:48:32.311 7f97923dfd68 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:48:32.311 7f97923dfd68 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:48:32.311 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:48:32.311 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:48:32.311 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:48:32.311 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:48:32.311 7f97923dfd68 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:48:32.311 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:32.312 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:48:32.312 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:32.312 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:32.312 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:48:32.312 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:36.312 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:48:36.315 7f97923dfd68 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:48:36.316 7f97923dfd68 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:48:36.316 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:48:36.316 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:48:36.316 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:48:36.316 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:48:36.316 7f97923dfd68 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:48:36.317 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:36.317 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:48:36.317 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:36.317 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:36.317 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:48:36.317 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:40.321 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:48:40.327 7f97923dfd68 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:48:40.328 7f97923dfd68 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:48:40.328 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:48:40.328 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:48:40.328 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:48:40.328 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:48:40.329 7f97923dfd68 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:48:40.329 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:40.329 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:48:40.329 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:40.329 7f97923dfd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:40.329 7f97923dfd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:48:40.329 7f97923dfd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:44.331 7f979218e630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:48:44.333 7f979218e630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:48:44.333 7f979218e630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:48:44.333 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:48:44.333 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:48:44.333 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:48:44.333 7f979218e630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:48:44.334 7f979218e630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:48:44.334 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:44.334 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:48:44.334 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:44.334 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:44.334 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:48:44.334 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:48.335 7f979218e630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:48:48.336 7f979218e630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:48:48.337 7f979218e630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:48:48.337 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:48:48.337 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:48:48.337 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:48:48.337 7f979218e630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:48:48.337 7f979218e630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:48:48.337 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:48.337 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:48:48.337 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:48.338 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:48.338 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:48:48.338 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:52.343 7f979218e630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:48:52.345 7f979218e630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:48:52.345 7f979218e630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:48:52.345 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:48:52.345 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:48:52.345 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:48:52.345 7f979218e630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:48:52.346 7f979218e630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:48:52.346 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:52.346 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:48:52.346 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:52.346 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:52.346 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:48:52.346 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:56.351 7f979218e630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:48:56.354 7f979218e630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:48:56.355 7f979218e630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:48:56.355 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:48:56.355 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:48:56.355 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:48:56.355 7f979218e630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:48:56.355 7f979218e630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:48:56.356 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:56.356 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:48:56.356 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:56.356 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:48:56.356 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:48:56.356 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:00.358 7f979218e630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:49:00.359 7f979218e630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:49:00.359 7f979218e630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:49:00.359 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:49:00.359 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:49:00.359 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:49:00.359 7f979218e630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:49:00.360 7f979218e630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:49:00.360 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:00.360 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:49:00.360 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:00.360 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:00.360 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:49:00.360 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:04.361 7f979218e630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:49:04.363 7f979218e630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:49:04.363 7f979218e630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:49:04.363 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:49:04.363 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:49:04.363 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:49:04.364 7f979218e630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:49:04.364 7f979218e630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:49:04.364 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:04.364 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:49:04.364 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:04.364 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:04.364 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:49:04.365 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:08.363 7f979218e630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:49:08.366 7f979218e630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:49:08.366 7f979218e630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:49:08.366 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:49:08.367 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:49:08.367 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:49:08.367 7f979218e630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:49:08.367 7f979218e630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:49:08.367 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:08.368 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:49:08.368 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:08.368 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:08.368 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:49:08.368 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:12.370 7f979218e630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:49:12.371 7f979218e630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:49:12.371 7f979218e630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:49:12.371 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:49:12.372 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:49:12.372 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:49:12.372 7f979218e630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:49:12.372 7f979218e630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:49:12.372 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:12.372 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:49:12.373 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:12.373 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:12.373 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:49:12.373 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:16.373 7f979218e630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:49:16.375 7f979218e630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:49:16.376 7f979218e630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:49:16.376 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:49:16.376 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:49:16.376 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:49:16.376 7f979218e630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:49:16.376 7f979218e630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:49:16.377 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:16.377 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:49:16.377 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:16.377 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:16.377 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:49:16.377 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:20.380 7f979218e630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:49:20.382 7f979218e630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:49:20.382 7f979218e630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:49:20.383 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:49:20.383 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:49:20.383 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:49:20.383 7f979218e630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:49:20.383 7f979218e630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:49:20.383 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:20.384 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:49:20.384 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:20.384 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:20.384 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:49:20.384 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:24.384 7f979218e630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:49:24.385 7f979218e630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:49:24.385 7f979218e630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:49:24.385 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:49:24.385 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:49:24.385 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:49:24.385 7f979218e630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:49:24.385 7f979218e630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:49:24.385 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:24.386 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:49:24.386 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:24.386 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:24.386 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:49:24.386 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:28.387 7f979218e630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:49:28.389 7f979218e630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:49:28.389 7f979218e630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:49:28.389 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:49:28.389 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:49:28.389 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:49:28.389 7f979218e630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:49:28.390 7f979218e630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:49:28.390 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:28.390 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:49:28.390 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:28.390 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:28.390 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:49:28.390 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:32.393 7f979218e630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:49:32.394 7f979218e630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:49:32.395 7f979218e630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:49:32.395 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:49:32.395 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:49:32.395 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:49:32.395 7f979218e630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:49:32.399 7f979218e630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:49:32.399 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:32.399 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:49:32.399 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:32.400 7f979218e630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:32.400 7f979218e630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:49:32.400 7f979218e630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:36.396 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:49:36.397 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:49:36.397 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:49:36.397 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:49:36.398 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:49:36.398 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:49:36.398 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:49:36.398 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:49:36.398 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:36.398 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:49:36.398 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:36.398 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:36.399 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:49:36.399 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:40.400 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:49:40.402 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:49:40.402 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:49:40.402 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:49:40.402 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:49:40.402 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:49:40.402 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:49:40.403 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:49:40.403 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:40.403 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:49:40.403 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:40.403 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:40.403 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:49:40.403 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:44.403 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:49:44.405 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:49:44.405 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:49:44.405 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:49:44.406 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:49:44.406 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:49:44.406 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:49:44.406 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:49:44.406 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:44.406 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:49:44.406 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:44.406 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:44.406 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:49:44.407 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:48.412 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:49:48.414 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:49:48.414 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:49:48.414 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:49:48.414 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:49:48.414 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:49:48.414 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:49:48.414 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:49:48.414 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:48.415 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:49:48.415 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:48.415 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:48.415 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:49:48.415 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:52.416 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:49:52.417 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:49:52.417 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:49:52.418 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:49:52.418 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:49:52.418 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:49:52.418 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:49:52.419 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:49:52.419 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:52.419 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:49:52.419 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:52.419 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:52.419 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:49:52.420 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:56.419 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:49:56.420 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:49:56.420 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:49:56.421 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:49:56.421 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:49:56.421 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:49:56.421 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:49:56.421 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:49:56.421 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:56.421 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:49:56.422 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:56.422 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:49:56.422 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:49:56.422 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:00.424 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:50:00.425 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:50:00.425 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:50:00.425 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:00.426 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:50:00.426 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:00.426 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:50:00.426 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:50:00.426 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:00.426 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:50:00.426 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:00.426 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:00.426 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:50:00.426 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:04.427 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:50:04.429 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:50:04.429 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:50:04.429 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:04.430 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:50:04.430 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:04.430 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:50:04.430 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:50:04.430 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:04.430 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:50:04.430 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:04.430 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:04.430 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:50:04.430 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:08.433 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:50:08.434 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:50:08.434 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:50:08.434 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:08.435 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:50:08.435 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:08.435 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:50:08.435 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:50:08.435 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:08.435 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:50:08.435 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:08.435 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:08.435 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:50:08.436 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:12.435 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:50:12.437 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:50:12.437 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:50:12.437 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:12.437 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:50:12.437 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:12.437 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:50:12.438 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:50:12.438 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:12.438 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:50:12.438 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:12.438 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:12.438 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:50:12.438 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:16.439 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:50:16.441 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:50:16.441 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:50:16.441 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:16.442 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:50:16.442 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:16.442 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:50:16.442 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:50:16.442 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:16.442 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:50:16.442 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:16.442 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:16.443 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:50:16.443 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:20.445 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:50:20.446 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:50:20.447 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:50:20.447 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:20.447 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:50:20.447 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:20.447 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:50:20.447 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:50:20.448 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:20.448 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:50:20.448 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:20.448 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:20.448 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:50:20.448 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:24.447 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:50:24.449 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:50:24.449 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:50:24.449 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:24.449 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:50:24.449 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:24.449 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:50:24.450 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:50:24.450 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:24.450 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:50:24.450 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:24.450 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:24.450 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:50:24.450 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:28.451 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:50:28.453 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:50:28.453 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:50:28.453 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:28.453 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:50:28.454 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:28.454 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:50:28.454 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:50:28.454 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:28.454 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:50:28.454 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:28.454 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:28.454 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:50:28.454 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:32.456 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:50:32.457 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:50:32.458 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:50:32.458 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:32.458 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:50:32.458 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:32.458 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:50:32.458 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:50:32.458 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:32.458 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:50:32.459 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:32.459 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:32.459 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:50:32.459 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:36.459 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:50:36.460 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:50:36.461 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:50:36.461 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:36.461 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:50:36.461 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:36.461 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:50:36.461 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:50:36.461 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:36.461 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:50:36.461 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:36.462 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:36.462 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:50:36.462 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:40.465 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:50:40.467 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:50:40.467 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:50:40.467 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:40.467 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:50:40.467 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:40.467 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:50:40.468 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:50:40.468 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:40.468 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:50:40.468 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:40.468 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:40.468 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:50:40.468 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:44.471 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:50:44.473 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:50:44.473 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:50:44.473 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:44.473 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:50:44.473 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:44.473 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:50:44.474 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:50:44.474 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:44.474 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:50:44.474 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:44.474 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:44.474 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:50:44.474 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:48.473 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:50:48.475 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:50:48.475 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:50:48.475 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:48.475 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:50:48.475 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:48.475 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:50:48.476 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:50:48.476 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:48.476 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:50:48.476 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:48.476 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:48.476 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:50:48.476 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:52.475 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:50:52.477 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:50:52.477 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:50:52.477 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:52.477 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:50:52.477 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:52.478 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:50:52.478 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:50:52.478 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:52.478 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:50:52.478 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:52.478 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:52.478 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:50:52.478 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:56.480 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:50:56.481 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:50:56.481 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:50:56.481 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:56.481 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:50:56.481 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:50:56.482 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:50:56.482 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:50:56.482 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:56.482 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:50:56.482 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:56.482 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:50:56.482 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:50:56.482 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:00.483 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:51:00.485 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:51:00.485 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:51:00.485 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:00.485 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:51:00.485 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:00.485 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:51:00.486 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:51:00.486 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:00.486 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:51:00.486 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:00.486 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:00.486 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:51:00.486 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:04.487 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:51:04.489 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:51:04.489 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:51:04.489 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:04.490 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:51:04.490 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:04.490 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:51:04.490 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:51:04.490 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:04.490 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:51:04.491 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:04.491 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:04.491 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:51:04.491 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:08.491 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:51:08.493 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:51:08.493 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:51:08.493 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:08.493 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:51:08.493 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:08.493 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:51:08.494 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:51:08.494 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:08.494 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:51:08.494 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:08.494 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:08.494 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:51:08.494 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:12.496 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:51:12.497 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:51:12.498 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:51:12.498 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:12.498 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:51:12.498 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:12.498 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:51:12.499 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:51:12.499 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:12.499 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:51:12.499 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:12.499 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:12.499 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:51:12.500 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:16.500 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:51:16.502 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:51:16.502 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:51:16.502 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:16.502 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:51:16.503 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:16.503 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:51:16.503 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:51:16.503 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:16.504 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:51:16.504 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:16.504 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:16.504 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:51:16.504 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:20.504 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:51:20.505 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:51:20.506 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:51:20.506 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:20.506 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:51:20.506 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:20.506 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:51:20.506 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:51:20.507 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:20.507 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:51:20.507 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:20.507 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:20.507 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:51:20.507 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:24.508 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:51:24.509 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:51:24.509 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:51:24.509 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:24.509 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:51:24.509 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:24.509 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:51:24.510 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:51:24.510 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:24.510 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:51:24.510 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:24.510 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:24.510 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:51:24.510 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:28.510 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:51:28.512 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:51:28.512 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:51:28.512 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:28.512 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:51:28.512 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:28.512 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:51:28.513 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:51:28.513 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:28.513 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:51:28.513 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:28.513 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:28.513 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:51:28.513 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:32.514 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:51:32.516 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:51:32.516 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:51:32.516 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:32.517 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:51:32.517 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:32.517 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:51:32.517 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:51:32.517 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:32.518 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:51:32.518 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:32.518 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:32.518 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:51:32.518 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:36.520 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:51:36.521 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:51:36.521 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:51:36.521 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:36.522 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:51:36.522 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:36.522 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:51:36.522 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:51:36.522 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:36.522 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:51:36.522 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:36.523 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:36.523 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:51:36.523 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:40.523 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:51:40.525 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:51:40.525 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:51:40.525 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:40.525 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:51:40.525 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:40.525 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:51:40.526 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:51:40.526 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:40.526 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:51:40.526 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:40.526 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:40.526 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:51:40.526 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:44.527 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:51:44.529 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:51:44.529 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:51:44.530 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:44.530 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:51:44.530 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:44.530 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:51:44.530 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:51:44.530 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:44.530 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:51:44.530 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:44.530 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:44.530 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:51:44.531 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:48.532 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:51:48.534 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:51:48.534 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:51:48.534 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:48.534 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:51:48.534 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:48.534 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:51:48.535 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:51:48.535 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:48.535 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:51:48.535 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:48.535 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:48.535 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:51:48.535 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:52.535 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:51:52.537 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:51:52.537 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:51:52.537 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:52.538 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:51:52.538 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:52.538 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:51:52.538 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:51:52.538 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:52.538 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:51:52.538 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:52.538 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:52.539 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:51:52.539 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:56.539 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:51:56.541 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:51:56.541 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:51:56.541 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:56.542 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:51:56.542 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:51:56.542 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:51:56.542 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:51:56.542 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:56.542 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:51:56.542 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:56.542 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:51:56.543 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:51:56.543 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:52:00.545 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:52:00.549 7f9799884198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 00:52:00.549 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:52:00.550 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:52:00.550 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:52:00.550 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:52:00.550 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 00:52:00.550 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 00:52:00.550 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:52:00.550 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 00:52:00.550 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:52:00.551 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:52:00.551 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 00:52:00.551 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:52:04.555 7f9799884198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:52:04.567 7f9799884198 [contrail-schema] [INFO]: Session Event: TCP Connected 01/20/2025 00:52:04.568 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:52:04.568 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:52:04.568 7f9799884198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:52:04.568 7f9799884198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:52:04.568 7f9799884198 [contrail-schema] [INFO]: Processing event[EvTcpConnected] in state[Connect] 01/20/2025 00:52:04.568 7f9799884198 [contrail-schema] [DEBUG]: Send sandesh control message. uve type count # 19 01/20/2025 00:52:04.569 7f9799884198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 01/20/2025 00:52:04.569 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 00:52:04.569 7f9799884198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 00:52:04.569 7f979219ad68 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/20/2025 00:52:04.571 7f979219ad68 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/20/2025 00:52:15.838 7f979219ac18 [contrail-schema] [DEBUG]: Extracted sandesh length: 0000001016 01/20/2025 00:52:15.839 7f979219ac18 [contrail-schema] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/20/2025 00:52:15.839 7f979335beb8 [contrail-schema] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 01/20/2025 00:52:15.839 7f979335beb8 [contrail-schema] [DEBUG]: Number of uve types in sandesh control message is 0 01/20/2025 00:52:15.839 7f979335beb8 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/20/2025 00:52:15.839 7f979335beb8 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 00:52:15.840 7f979335beb8 [contrail-schema] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 01/20/2025 00:52:15.840 7f97927abcc0 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/20/2025 00:52:15.842 7f97927abcc0 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/20/2025 00:52:28.495 7f979219ac18 [contrail-schema] [DEBUG]: Extracted sandesh length: 0000001297 01/20/2025 00:52:28.499 7f979219ac18 [contrail-schema] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/20/2025 00:52:28.499 7f97927abcc0 [contrail-schema] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 01/20/2025 00:52:28.500 7f97927abcc0 [contrail-schema] [DEBUG]: Number of uve types in sandesh control message is 2 01/20/2025 00:52:28.500 7f97927abcc0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/20/2025 00:52:28.500 7f97927abcc0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 01:47:03.698 7f97989f9448 [contrail-schema] [WARNING]: Elected master Schema Transformer node. Initializing... 01/20/2025 01:47:03.698 7f97989f9448 [contrail-schema] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8087 01/20/2025 01:47:03.714 7f97989f9448 [contrail-schema] [DEBUG]: Add [config_updater.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/config_updater] to home page 01/20/2025 01:47:03.715 7f97989f9448 [contrail-schema] [DEBUG]: Add http request [/Snh_ConfigApiUpdateReq] 01/20/2025 01:47:03.715 7f97989f9448 [contrail-schema] [DEBUG]: Add [greenlets.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/greenlets] to home page 01/20/2025 01:47:03.716 7f97989f9448 [contrail-schema] [DEBUG]: Add http request [/Snh_GreenletObjectReq] 01/20/2025 01:47:03.717 7f97989f9448 [contrail-schema] [DEBUG]: Add [cpuinfo.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/nodeinfo/cpuinfo] to home page 01/20/2025 01:47:03.718 7f97989f9448 [contrail-schema] [DEBUG]: Add http request [/Snh_CpuLoadInfoReq] 01/20/2025 01:47:03.733 7f97989f9448 [contrail-schema] [DEBUG]: Add [st_introspect.xml:/usr/lib/python3.6/site-packages/schema_transformer/sandesh/st_introspect] to home page 01/20/2025 01:47:03.733 7f97989f9448 [contrail-schema] [DEBUG]: Add http request [/Snh_VnList] 01/20/2025 01:47:03.733 7f97989f9448 [contrail-schema] [DEBUG]: Add http request [/Snh_RoutingInstanceList] 01/20/2025 01:47:03.733 7f97989f9448 [contrail-schema] [DEBUG]: Add http request [/Snh_ServiceChainList] 01/20/2025 01:47:03.733 7f97989f9448 [contrail-schema] [DEBUG]: Add http request [/Snh_StObjectReq] 01/20/2025 01:47:03.736 7f97989f9448 [contrail-schema] [DEBUG]: Add [sandesh_alarm.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_alarm] to home page 01/20/2025 01:47:03.736 7f97989f9448 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshAlarmCacheRequest] 01/20/2025 01:47:03.736 7f97989f9448 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshAlarmTypesRequest] 01/20/2025 01:47:03.736 7f97989f9448 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshAlarmAckRequest] 01/20/2025 01:47:03.737 7f97989f9448 [contrail-schema] [DEBUG]: Add [sandesh_ctrl.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_ctrl] to home page 01/20/2025 01:47:03.737 7f97989f9448 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshCtrlClientToServer] 01/20/2025 01:47:03.737 7f97989f9448 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshCtrlServerToClient] 01/20/2025 01:47:03.738 7f97989f9448 [contrail-schema] [DEBUG]: Add [sandesh_trace.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_trace] to home page 01/20/2025 01:47:03.738 7f97989f9448 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshTraceRequest] 01/20/2025 01:47:03.738 7f97989f9448 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshTraceBufferListRequest] 01/20/2025 01:47:03.738 7f97989f9448 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshTraceEnableDisableReq] 01/20/2025 01:47:03.738 7f97989f9448 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshTraceBufStatusReq] 01/20/2025 01:47:03.738 7f97989f9448 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshTraceBufferEnableDisableReq] 01/20/2025 01:47:03.743 7f97989f9448 [contrail-schema] [DEBUG]: Add [sandesh_uve.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_uve] to home page 01/20/2025 01:47:03.743 7f97989f9448 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshMessageStatsReq] 01/20/2025 01:47:03.743 7f97989f9448 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsSet] 01/20/2025 01:47:03.743 7f97989f9448 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsStatus] 01/20/2025 01:47:03.743 7f97989f9448 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshSendingParamsSet] 01/20/2025 01:47:03.744 7f97989f9448 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshSendingParamsStatus] 01/20/2025 01:47:03.744 7f97989f9448 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsSet] 01/20/2025 01:47:03.744 7f97989f9448 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsReset] 01/20/2025 01:47:03.744 7f97989f9448 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsStatus] 01/20/2025 01:47:03.744 7f97989f9448 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshSendQueueSet] 01/20/2025 01:47:03.744 7f97989f9448 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshSendQueueStatus] 01/20/2025 01:47:03.744 7f97989f9448 [contrail-schema] [DEBUG]: Add http request [/Snh_CollectorInfoRequest] 01/20/2025 01:47:03.744 7f97989f9448 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshUVEDSConfReq] 01/20/2025 01:47:03.744 7f97989f9448 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshUVECacheReq] 01/20/2025 01:47:03.744 7f97989f9448 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshUVETypesReq] 01/20/2025 01:47:03.766 7f9792191e10 [contrail-schema] [ERROR]: Cannot write http_port 8087 to /tmp/contrail-schema.0.http_port 01/20/2025 01:47:03.766 7f9792191e10 [contrail-schema] [ERROR]: Starting Introspect on HTTP Port 8087 01/20/2025 01:47:03.768 7f979219ac18 [contrail-schema] [ERROR]: Session Event: TCP Connection Closed 01/20/2025 01:47:03.768 7f979219a240 [contrail-schema] [INFO]: Processing event[EvTcpClose] in state[Established] 01/20/2025 01:47:03.782 7f97989f9448 [contrail-schema] [WARNING]: VNCCassandra started with driver cql 01/20/2025 01:47:03.782 7f97989f9448 [contrail-schema] [WARNING]: initializing cassandra cluster 01/20/2025 01:47:03.783 7f97989f9448 [contrail-schema] [WARNING]: CassandraDriverCQL.__init__Cluster before create 01/20/2025 01:47:03.783 7f979219a240 [contrail-schema] [INFO]: Session Event: TCP Connected 01/20/2025 01:47:03.783 7f979219a240 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpClose] => State[Established] -> State[Connect] 01/20/2025 01:47:03.783 7f979219a240 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:47:03.784 7f979219a240 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Established to Connect on EvTcpClose >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.42,10.0.0.22,10.0.0.49:8082, ] status = Initializing description = ApiServer >>, ] description = Collector:Collector[Established to Connect on EvTcpClose], ApiServer:ApiServer[ApiServer] connection down >>, ] >> 01/20/2025 01:47:03.784 7f979219a240 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:47:03.784 7f979219a240 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:47:03.784 7f979219a240 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Established to Connect on EvTcpClose >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.42,10.0.0.22,10.0.0.49:8082, ] status = Up description = ApiServer >>, ] description = Collector:Collector[Established to Connect on EvTcpClose] connection down >>, ] >> 01/20/2025 01:47:03.784 7f979219a240 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:47:03.784 7f979219a240 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:47:03.784 7f979219a240 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Established to Connect on EvTcpClose >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.42,10.0.0.22,10.0.0.49:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.22:9041, 10.0.0.49:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Established to Connect on EvTcpClose], Database:Cassandra[] connection down >>, ] >> 01/20/2025 01:47:03.786 7f979219a240 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:47:03.786 7f979219a240 [contrail-schema] [INFO]: Processing event[EvTcpConnected] in state[Connect] 01/20/2025 01:47:03.786 7f979219a240 [contrail-schema] [DEBUG]: Send sandesh control message. uve type count # 19 01/20/2025 01:47:03.787 7f979219a240 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 01/20/2025 01:47:03.787 7f979219a240 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:47:03.787 7f979219a240 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:47:03.788 7f979196e4e0 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/20/2025 01:47:03.789 7f979196e4e0 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/20/2025 01:47:03.791 7f97989f9448 [contrail-schema] [WARNING]: CassandraDriverCQL.__init__Cluster created 01/20/2025 01:47:03.912 7f97989f9448 [contrail-schema] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 01/20/2025 01:47:03.914 7f979195f240 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:47:04.085 7f97923efcc0 [contrail-schema] [ERROR]: Session Event: TCP Connection Closed 01/20/2025 01:47:04.086 7f979195f390 [contrail-schema] [INFO]: Processing event[EvTcpClose] in state[ClientInit] 01/20/2025 01:47:04.087 7f979195f390 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle] 01/20/2025 01:47:04.087 7f979195f390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:04.087 7f979195f390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = ClientInit to Idle on EvTcpClose >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Initializing description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.42,10.0.0.22,10.0.0.49:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.22:9041, 10.0.0.49:9041, ] status = Initializing description = >>, ] description = Collector:Collector[ClientInit to Idle on EvTcpClose], Zookeeper:Zookeeper[], Database:Cassandra[] connection down >>, ] >> 01/20/2025 01:47:04.087 7f979195f390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:04.087 7f979195f390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:04.087 7f979195f390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 2 pid = 1 http_port = 8087 start_time = 1737334076272878 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.42:8086, 10.0.0.22:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:47:04.087 7f979195f390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:04.300 7f979195f390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:04.300 7f979195f390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = ClientInit to Idle on EvTcpClose >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Initializing description = Connection to zookeeper lost. Retrying >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.42,10.0.0.22,10.0.0.49:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.22:9041, 10.0.0.49:9041, ] status = Initializing description = >>, ] description = Collector:Collector[ClientInit to Idle on EvTcpClose], Zookeeper:Zookeeper[Connection to zookeeper lost. Retrying], Database:Cassandra[] connection down >>, ] >> 01/20/2025 01:47:04.301 7f979195f390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:08.087 7f97917876d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:47:08.091 7f97917876d8 [contrail-schema] [INFO]: Session Event: TCP Connected 01/20/2025 01:47:08.091 7f97917876d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:47:08.091 7f97917876d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:47:08.091 7f97917876d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Initializing description = Connection to zookeeper lost. Retrying >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.42,10.0.0.22,10.0.0.49:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.42:9041, 10.0.0.22:9041, 10.0.0.49:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Zookeeper:Zookeeper[Connection to zookeeper lost. Retrying], Database:Cassandra[] connection down >>, ] >> 01/20/2025 01:47:08.091 7f97917876d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:47:08.091 7f97917876d8 [contrail-schema] [INFO]: Processing event[EvTcpConnected] in state[Connect] 01/20/2025 01:47:08.092 7f97917876d8 [contrail-schema] [DEBUG]: Send sandesh control message. uve type count # 19 01/20/2025 01:47:08.092 7f97917876d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 01/20/2025 01:47:08.092 7f97917876d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:47:08.092 7f97917876d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:47:08.092 7f9794f464e0 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/20/2025 01:47:08.093 7f9794f464e0 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/20/2025 01:47:08.106 7f97922bc198 [contrail-schema] [DEBUG]: Extracted sandesh length: 0000001017 01/20/2025 01:47:08.106 7f97922bc198 [contrail-schema] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/20/2025 01:47:08.106 7f9793690390 [contrail-schema] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 01/20/2025 01:47:08.107 7f9793690390 [contrail-schema] [DEBUG]: Number of uve types in sandesh control message is 0 01/20/2025 01:47:08.107 7f9793690390 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/20/2025 01:47:08.107 7f9793690390 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 01:47:08.108 7f9793690390 [contrail-schema] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 01/20/2025 01:47:08.110 7f97917876d8 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/20/2025 01:47:08.113 7f97917876d8 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/20/2025 01:47:26.218 7f9a3d43a488 [contrail-schema] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 01/20/2025 01:47:26.218 7f9a3d43a488 [contrail-schema] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 01/20/2025 01:47:26.218 7f9a3d43a488 [contrail-schema] [INFO]: SANDESH: Flow Logging: [None] -> [False] 01/20/2025 01:47:26.219 7f9a372000f0 [contrail-schema] [INFO]: Processing event[EvStart] in state[none] 01/20/2025 01:47:26.219 7f9a372000f0 [contrail-schema] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 01/20/2025 01:47:26.219 7f9a372000f0 [contrail-schema] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 01:47:26.219 7f9a372000f0 [contrail-schema] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 01/20/2025 01:47:26.220 7f9a372000f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:26.220 7f9a372000f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 01:47:26.220 7f9a372000f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:26.220 7f9a372000f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:26.220 7f9a372000f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737337646219712 collector_name = collector_ip = collector_list = [ 10.0.0.22:8086, 10.0.0.42:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 01/20/2025 01:47:26.220 7f9a372000f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:26.353 7f9a3d43a488 [contrail-schema] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.42:5673//', 'pyamqp://guest:guest@10.0.0.22:5673//', 'pyamqp://guest:guest@10.0.0.49:5673//'] 01/20/2025 01:47:26.362 7f9a3d43a488 [contrail-schema] [WARNING]: RabbitMQ drainer connection down 01/20/2025 01:47:26.363 7f9a36ca3630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:26.363 7f9a36ca3630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/20/2025 01:47:26.363 7f9a36ca3630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:26.363 7f9a36ca3630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:26.364 7f9a36ca3630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/20/2025 01:47:26.364 7f9a36ca3630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:26.373 7f9a3d43a488 [contrail-schema] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/20/2025 01:47:26.373 7f9a36d30f60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:26.373 7f9a36d30f60 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 01:47:26.374 7f9a36d30f60 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:26.397 7f9a3d43a488 [contrail-schema] [WARNING]: RabbitMQ publish connection down 01/20/2025 01:47:26.398 7f9a36d30eb8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:26.398 7f9a36d30eb8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/20/2025 01:47:26.398 7f9a36d30eb8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:26.403 7f9a3d43a488 [contrail-schema] [WARNING]: RabbitMQ publish connection ESTABLISHED 01/20/2025 01:47:26.404 7f9a43891978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:26.404 7f9a43891978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 01:47:26.404 7f9a43891978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:26.414 7f9a3d43a488 [contrail-schema] [DEBUG]: Removed remained AMQP queue 01/20/2025 01:47:26.416 7f9a36ccc8d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:26.416 7f9a36ccc8d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Zookeeper:Zookeeper[] connection down >>, ] >> 01/20/2025 01:47:26.416 7f9a36ccc8d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:30.223 7f9a36deae10 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:47:30.227 7f9a36deae10 [contrail-schema] [INFO]: Session Event: TCP Connected 01/20/2025 01:47:30.228 7f9a36deae10 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:47:30.228 7f9a36deae10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:47:30.228 7f9a36deae10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Zookeeper:Zookeeper[] connection down >>, ] >> 01/20/2025 01:47:30.228 7f9a36deae10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:47:30.228 7f9a36deae10 [contrail-schema] [INFO]: Processing event[EvTcpConnected] in state[Connect] 01/20/2025 01:47:30.228 7f9a36deae10 [contrail-schema] [DEBUG]: Send sandesh control message. uve type count # 19 01/20/2025 01:47:30.229 7f9a36deae10 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 01/20/2025 01:47:30.229 7f9a36deae10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:47:30.229 7f9a36deae10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:47:30.229 7f9a36df68d0 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/20/2025 01:47:30.230 7f9a36df68d0 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/20/2025 01:47:32.109 7f9a3d43a488 [contrail-schema] [WARNING]: Waiting to be elected as master... 01/20/2025 01:47:32.113 7f9a3bbf72e8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:47:33.940 7f9a36df6780 [contrail-schema] [ERROR]: Session Event: TCP Connection Closed 01/20/2025 01:47:33.940 7f9a36deaa20 [contrail-schema] [INFO]: Processing event[EvTcpClose] in state[ClientInit] 01/20/2025 01:47:33.940 7f9a36deaa20 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle] 01/20/2025 01:47:33.941 7f9a36deaa20 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:33.941 7f9a36deaa20 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = ClientInit to Idle on EvTcpClose >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[ClientInit to Idle on EvTcpClose] connection down >>, ] >> 01/20/2025 01:47:33.941 7f9a36deaa20 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:33.941 7f9a36deaa20 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:33.941 7f9a36deaa20 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 1 pid = 1 start_time = 1737337646219712 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.42:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 01:47:33.941 7f9a36deaa20 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:37.945 7f9a36deaa20 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:47:37.946 7f9a36deaa20 [contrail-schema] [INFO]: Session Event: TCP Connected 01/20/2025 01:47:37.946 7f9a36deaa20 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:47:37.946 7f9a36deaa20 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:47:37.947 7f9a36deaa20 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:47:37.947 7f9a36deaa20 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:47:37.947 7f9a36deaa20 [contrail-schema] [INFO]: Processing event[EvTcpConnected] in state[Connect] 01/20/2025 01:47:37.947 7f9a36deaa20 [contrail-schema] [DEBUG]: Send sandesh control message. uve type count # 19 01/20/2025 01:47:37.947 7f9a36deaa20 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 01/20/2025 01:47:37.947 7f9a36deaa20 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:47:37.947 7f9a36deaa20 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:47:37.947 7f9a36e084e0 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/20/2025 01:47:37.948 7f9a36e084e0 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/20/2025 01:47:37.961 7f9a36e08390 [contrail-schema] [DEBUG]: Extracted sandesh length: 0000001017 01/20/2025 01:47:37.961 7f9a36e08390 [contrail-schema] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/20/2025 01:47:37.962 7f9a36deaa20 [contrail-schema] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 01/20/2025 01:47:37.963 7f9a36deaa20 [contrail-schema] [DEBUG]: Number of uve types in sandesh control message is 0 01/20/2025 01:47:37.963 7f9a36deaa20 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/20/2025 01:47:37.964 7f9a36deaa20 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 01:47:37.965 7f9a36deaa20 [contrail-schema] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 01/20/2025 01:47:37.967 7f9a36df6588 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/20/2025 01:47:37.972 7f9a36df6588 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/20/2025 01:51:37.813 7fe72fa39308 [contrail-schema] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 01/20/2025 01:51:37.813 7fe72fa39308 [contrail-schema] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 01/20/2025 01:51:37.813 7fe72fa39308 [contrail-schema] [INFO]: SANDESH: Flow Logging: [None] -> [False] 01/20/2025 01:51:37.813 7fe72e8d2b70 [contrail-schema] [INFO]: Processing event[EvStart] in state[none] 01/20/2025 01:51:37.814 7fe72e8d2b70 [contrail-schema] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 01/20/2025 01:51:37.814 7fe72e8d2b70 [contrail-schema] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 01:51:37.814 7fe72e8d2b70 [contrail-schema] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 01/20/2025 01:51:37.814 7fe72e8d2b70 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:37.814 7fe72e8d2b70 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 01:51:37.815 7fe72e8d2b70 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:37.815 7fe72e8d2b70 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:37.815 7fe72e8d2b70 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737337897814440 collector_name = collector_ip = collector_list = [ 10.0.0.22:8086, 10.0.0.42:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 01/20/2025 01:51:37.815 7fe72e8d2b70 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:37.900 7fe72fa39308 [contrail-schema] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.42:5673//', 'pyamqp://guest:guest@10.0.0.22:5673//', 'pyamqp://guest:guest@10.0.0.49:5673//'] 01/20/2025 01:51:37.936 7fe72fa39308 [contrail-schema] [WARNING]: RabbitMQ drainer connection down 01/20/2025 01:51:37.937 7fe72d4f3048 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:37.937 7fe72d4f3048 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/20/2025 01:51:37.937 7fe72d4f3048 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:37.938 7fe72d4f3048 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:37.938 7fe72d4f3048 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/20/2025 01:51:37.938 7fe72d4f3048 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:37.962 7fe72fa39308 [contrail-schema] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/20/2025 01:51:37.962 7fe72d4f3198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:37.963 7fe72d4f3198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 01:51:37.963 7fe72d4f3198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:38.177 7fe72fa39308 [contrail-schema] [WARNING]: RabbitMQ publish connection down 01/20/2025 01:51:38.178 7fe72cf8f4e0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:38.178 7fe72cf8f4e0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/20/2025 01:51:38.178 7fe72cf8f4e0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:38.183 7fe72fa39308 [contrail-schema] [WARNING]: RabbitMQ publish connection ESTABLISHED 01/20/2025 01:51:38.183 7fe736254978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:38.183 7fe736254978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 01:51:38.183 7fe736254978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:38.258 7fe72fa39308 [contrail-schema] [DEBUG]: Removed remained AMQP queue 01/20/2025 01:51:38.259 7fe72cfa80f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:38.259 7fe72cfa80f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Zookeeper:Zookeeper[] connection down >>, ] >> 01/20/2025 01:51:38.259 7fe72cfa80f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:38.267 7fe72fa39308 [contrail-schema] [WARNING]: Waiting to be elected as master... 01/20/2025 01:51:38.268 7fe72d4216d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:38.268 7fe72d4216d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 01:51:38.268 7fe72d4216d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:41.816 7fe72d421630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:51:41.817 7fe72d421630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:51:41.817 7fe72d421630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:51:41.817 7fe72d421630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:41.818 7fe72d421630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:51:41.818 7fe72d421630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:41.818 7fe72d421630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:51:41.818 7fe72d421630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:51:41.818 7fe72d421630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:41.819 7fe72d421630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:51:41.819 7fe72d421630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:41.819 7fe72d421630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:41.819 7fe72d421630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737337897814440 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.42:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 01:51:41.819 7fe72d421630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:45.820 7fe72d421630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:51:45.821 7fe72d421630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:51:45.821 7fe72d421630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:51:45.821 7fe72d421630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:45.821 7fe72d421630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:51:45.821 7fe72d421630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:45.821 7fe72d421630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:51:45.822 7fe72d421630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:51:45.822 7fe72d421630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:45.822 7fe72d421630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:51:45.822 7fe72d421630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:45.822 7fe72d421630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:45.822 7fe72d421630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737337897814440 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.42:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 01:51:45.822 7fe72d421630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:49.824 7fe72d421630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:51:49.825 7fe72d421630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:51:49.826 7fe72d421630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:51:49.826 7fe72d421630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:49.826 7fe72d421630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:51:49.826 7fe72d421630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:49.826 7fe72d421630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:51:49.826 7fe72d421630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:51:49.827 7fe72d421630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:49.827 7fe72d421630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:51:49.827 7fe72d421630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:49.827 7fe72d421630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:49.827 7fe72d421630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737337897814440 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.42:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 01:51:49.827 7fe72d421630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:53.827 7fe72d421630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:51:53.829 7fe72d421630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:51:53.829 7fe72d421630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:51:53.829 7fe72d421630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:53.829 7fe72d421630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:51:53.830 7fe72d421630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:53.830 7fe72d421630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:51:53.830 7fe72d421630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:51:53.830 7fe72d421630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:53.830 7fe72d421630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:51:53.830 7fe72d421630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:53.830 7fe72d421630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:53.830 7fe72d421630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737337897814440 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.42:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 01:51:53.830 7fe72d421630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:57.831 7fe72d421630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:51:57.833 7fe72d421630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:51:57.833 7fe72d421630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:51:57.833 7fe72d421630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:57.833 7fe72d421630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:51:57.833 7fe72d421630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:51:57.833 7fe72d421630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:51:57.834 7fe72d421630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:51:57.834 7fe72d421630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:57.834 7fe72d421630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:51:57.834 7fe72d421630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:57.834 7fe72d421630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:51:57.834 7fe72d421630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737337897814440 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.42:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 01:51:57.834 7fe72d421630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:01.836 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:52:01.837 7fe72d434a20 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:52:01.837 7fe72d434a20 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:52:01.837 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:52:01.838 7fe72d434a20 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:52:01.838 7fe72d434a20 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:52:01.838 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:52:01.838 7fe72d434a20 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:52:01.838 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:01.838 7fe72d434a20 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:52:01.838 7fe72d434a20 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:01.838 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:01.838 7fe72d434a20 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737337897814440 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.42:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 01:52:01.839 7fe72d434a20 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:05.838 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:52:05.840 7fe72d434a20 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:52:05.840 7fe72d434a20 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:52:05.840 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:52:05.841 7fe72d434a20 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:52:05.841 7fe72d434a20 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:52:05.841 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:52:05.841 7fe72d434a20 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:52:05.841 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:05.841 7fe72d434a20 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:52:05.841 7fe72d434a20 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:05.841 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:05.841 7fe72d434a20 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737337897814440 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.42:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 01:52:05.841 7fe72d434a20 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:09.843 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:52:09.848 7fe72d434a20 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:52:09.848 7fe72d434a20 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:52:09.848 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:52:09.848 7fe72d434a20 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:52:09.848 7fe72d434a20 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:52:09.848 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:52:09.849 7fe72d434a20 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:52:09.849 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:09.849 7fe72d434a20 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:52:09.849 7fe72d434a20 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:09.849 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:09.849 7fe72d434a20 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737337897814440 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.42:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 01:52:09.849 7fe72d434a20 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:13.852 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:52:13.853 7fe72d434a20 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:52:13.854 7fe72d434a20 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:52:13.854 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:52:13.854 7fe72d434a20 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:52:13.854 7fe72d434a20 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:52:13.854 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:52:13.855 7fe72d434a20 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:52:13.855 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:13.855 7fe72d434a20 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:52:13.855 7fe72d434a20 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:13.855 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:13.856 7fe72d434a20 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737337897814440 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.42:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 01:52:13.856 7fe72d434a20 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:17.855 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:52:17.858 7fe72d434a20 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:52:17.859 7fe72d434a20 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:52:17.859 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:52:17.859 7fe72d434a20 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:52:17.859 7fe72d434a20 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:52:17.859 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:52:17.860 7fe72d434a20 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:52:17.860 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:17.860 7fe72d434a20 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:52:17.860 7fe72d434a20 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:17.860 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:17.861 7fe72d434a20 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737337897814440 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.42:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 01:52:17.861 7fe72d434a20 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:21.861 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:52:21.863 7fe72d434a20 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:52:21.863 7fe72d434a20 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:52:21.863 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:52:21.863 7fe72d434a20 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:52:21.863 7fe72d434a20 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:52:21.863 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:52:21.864 7fe72d434a20 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:52:21.864 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:21.864 7fe72d434a20 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:52:21.864 7fe72d434a20 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:21.864 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:21.864 7fe72d434a20 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737337897814440 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.42:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/20/2025 01:52:21.864 7fe72d434a20 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:25.866 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:52:25.868 7fe72d434a20 [contrail-schema] [INFO]: Session Event: TCP Connected 01/20/2025 01:52:25.869 7fe72d434a20 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:52:25.869 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:52:25.869 7fe72d434a20 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:52:25.869 7fe72d434a20 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:52:25.869 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvTcpConnected] in state[Connect] 01/20/2025 01:52:25.869 7fe72d434a20 [contrail-schema] [DEBUG]: Send sandesh control message. uve type count # 19 01/20/2025 01:52:25.870 7fe72d434a20 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 01/20/2025 01:52:25.870 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:52:25.870 7fe72d434a20 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:52:25.870 7fe72d440cc0 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/20/2025 01:52:25.872 7fe72d440cc0 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/20/2025 01:52:27.197 7fe72d440b70 [contrail-schema] [DEBUG]: Extracted sandesh length: 0000001016 01/20/2025 01:52:27.198 7fe72d440b70 [contrail-schema] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/20/2025 01:52:27.198 7fe72d440d68 [contrail-schema] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 01/20/2025 01:52:27.199 7fe72d440d68 [contrail-schema] [DEBUG]: Number of uve types in sandesh control message is 0 01/20/2025 01:52:27.199 7fe72d440d68 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/20/2025 01:52:27.199 7fe72d440d68 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 01:52:27.199 7fe72d440d68 [contrail-schema] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 01/20/2025 01:52:27.199 7fe72d4408d0 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/20/2025 01:52:27.200 7fe72d4408d0 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/20/2025 01:52:37.126 7fe72d440b70 [contrail-schema] [DEBUG]: Extracted sandesh length: 0000001296 01/20/2025 01:52:37.126 7fe72d440b70 [contrail-schema] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/20/2025 01:52:37.127 7fe72dcea828 [contrail-schema] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 01/20/2025 01:52:37.127 7fe72dcea828 [contrail-schema] [DEBUG]: Number of uve types in sandesh control message is 2 01/20/2025 01:52:37.127 7fe72dcea828 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/20/2025 01:52:37.127 7fe72dcea828 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 01:56:39.781 7f8187fefe08 [contrail-schema] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 01/20/2025 01:56:39.782 7f8187fefe08 [contrail-schema] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 01/20/2025 01:56:39.782 7f8187fefe08 [contrail-schema] [INFO]: SANDESH: Flow Logging: [None] -> [False] 01/20/2025 01:56:39.782 7f8185a46b70 [contrail-schema] [INFO]: Processing event[EvStart] in state[none] 01/20/2025 01:56:39.783 7f8185a46b70 [contrail-schema] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 01/20/2025 01:56:39.783 7f8185a46b70 [contrail-schema] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 01:56:39.783 7f8185a46b70 [contrail-schema] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 01/20/2025 01:56:39.783 7f8185a46b70 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:56:39.783 7f8185a46b70 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 01:56:39.783 7f8185a46b70 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:56:39.783 7f8185a46b70 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:56:39.784 7f8185a46b70 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737338199783321 collector_name = collector_ip = collector_list = [ 10.0.0.22:8086, 10.0.0.42:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 01/20/2025 01:56:39.784 7f8185a46b70 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:56:39.935 7f8187fefe08 [contrail-schema] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.42:5673//', 'pyamqp://guest:guest@10.0.0.22:5673//', 'pyamqp://guest:guest@10.0.0.49:5673//'] 01/20/2025 01:56:39.946 7f8187fefe08 [contrail-schema] [WARNING]: RabbitMQ drainer connection down 01/20/2025 01:56:39.946 7f8186aaf048 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:56:39.947 7f8186aaf048 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/20/2025 01:56:39.947 7f8186aaf048 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:56:39.947 7f8186aaf048 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:56:39.947 7f8186aaf048 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/20/2025 01:56:39.947 7f8186aaf048 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:56:39.963 7f8187fefe08 [contrail-schema] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/20/2025 01:56:39.964 7f8186aaf198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:56:39.964 7f8186aaf198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 01:56:39.964 7f8186aaf198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:56:40.031 7f8187fefe08 [contrail-schema] [WARNING]: RabbitMQ publish connection down 01/20/2025 01:56:40.032 7f818556e4e0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:56:40.033 7f818556e4e0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/20/2025 01:56:40.033 7f818556e4e0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:56:40.035 7f8187fefe08 [contrail-schema] [WARNING]: RabbitMQ publish connection ESTABLISHED 01/20/2025 01:56:40.036 7f818e7f3978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:56:40.036 7f818e7f3978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 01:56:40.036 7f818e7f3978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:56:40.082 7f8187fefe08 [contrail-schema] [DEBUG]: Removed remained AMQP queue 01/20/2025 01:56:40.083 7f81855880f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:56:40.083 7f81855880f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Zookeeper:Zookeeper[] connection down >>, ] >> 01/20/2025 01:56:40.084 7f81855880f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:56:40.093 7f8187fefe08 [contrail-schema] [WARNING]: Waiting to be elected as master... 01/20/2025 01:56:40.093 7f81859876d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:56:40.094 7f81859876d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 01:56:40.096 7f81859876d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:56:43.783 7f8185987630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:56:43.785 7f8185987630 [contrail-schema] [INFO]: Session Event: TCP Connected 01/20/2025 01:56:43.785 7f8185987630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:56:43.785 7f8185987630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:56:43.786 7f8185987630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:56:43.786 7f8185987630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:56:43.786 7f8185987630 [contrail-schema] [INFO]: Processing event[EvTcpConnected] in state[Connect] 01/20/2025 01:56:43.786 7f8185987630 [contrail-schema] [DEBUG]: Send sandesh control message. uve type count # 19 01/20/2025 01:56:43.786 7f8185987630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 01/20/2025 01:56:43.786 7f8185987630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:56:43.786 7f8185987630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:56:43.787 7f818598fac8 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/20/2025 01:56:43.787 7f818598fac8 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/20/2025 01:56:43.792 7f818598f978 [contrail-schema] [DEBUG]: Extracted sandesh length: 0000001017 01/20/2025 01:56:43.792 7f818598f978 [contrail-schema] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/20/2025 01:56:43.792 7f8185a46048 [contrail-schema] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 01/20/2025 01:56:43.793 7f8185a46048 [contrail-schema] [DEBUG]: Number of uve types in sandesh control message is 0 01/20/2025 01:56:43.793 7f8185a46048 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/20/2025 01:56:43.793 7f8185a46048 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 01:56:43.793 7f8185a46048 [contrail-schema] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 01/20/2025 01:56:43.793 7f818598fb70 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/20/2025 01:56:43.794 7f818598fb70 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/20/2025 01:58:53.934 7f047af961c8 [contrail-schema] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 01/20/2025 01:58:53.935 7f047af961c8 [contrail-schema] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 01/20/2025 01:58:53.935 7f047af961c8 [contrail-schema] [INFO]: SANDESH: Flow Logging: [None] -> [False] 01/20/2025 01:58:53.935 7f0479edeb70 [contrail-schema] [INFO]: Processing event[EvStart] in state[none] 01/20/2025 01:58:53.936 7f0479edeb70 [contrail-schema] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 01/20/2025 01:58:53.936 7f0479edeb70 [contrail-schema] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 01:58:53.936 7f0479edeb70 [contrail-schema] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 01/20/2025 01:58:53.936 7f0479edeb70 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:58:53.937 7f0479edeb70 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 01:58:53.937 7f0479edeb70 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:58:53.937 7f0479edeb70 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:58:53.937 7f0479edeb70 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1737338333936677 collector_name = collector_ip = collector_list = [ 10.0.0.42:8086, 10.0.0.49:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 01/20/2025 01:58:53.937 7f0479edeb70 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:58:54.104 7f047af961c8 [contrail-schema] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.42:5673//', 'pyamqp://guest:guest@10.0.0.22:5673//', 'pyamqp://guest:guest@10.0.0.49:5673//'] 01/20/2025 01:58:54.114 7f047af961c8 [contrail-schema] [WARNING]: RabbitMQ drainer connection down 01/20/2025 01:58:54.117 7f047921e048 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:58:54.117 7f047921e048 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/20/2025 01:58:54.117 7f047921e048 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:58:54.117 7f047921e048 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:58:54.117 7f047921e048 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/20/2025 01:58:54.118 7f047921e048 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:58:54.134 7f047af961c8 [contrail-schema] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/20/2025 01:58:54.135 7f047921e198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:58:54.136 7f047921e198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 01:58:54.136 7f047921e198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:58:54.187 7f047af961c8 [contrail-schema] [WARNING]: RabbitMQ publish connection down 01/20/2025 01:58:54.188 7f04784ff4e0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:58:54.188 7f04784ff4e0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/20/2025 01:58:54.189 7f04784ff4e0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:58:54.194 7f047af961c8 [contrail-schema] [WARNING]: RabbitMQ publish connection ESTABLISHED 01/20/2025 01:58:54.194 7f0481784978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:58:54.194 7f0481784978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 01:58:54.195 7f0481784978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:58:54.234 7f047af961c8 [contrail-schema] [DEBUG]: Removed remained AMQP queue 01/20/2025 01:58:54.235 7f04785170f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:58:54.235 7f04785170f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Zookeeper:Zookeeper[] connection down >>, ] >> 01/20/2025 01:58:54.235 7f04785170f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:58:54.243 7f047af961c8 [contrail-schema] [WARNING]: Waiting to be elected as master... 01/20/2025 01:58:54.244 7f04789506d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:58:54.244 7f04789506d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 01:58:54.244 7f04789506d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:58:57.940 7f0478950630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:58:57.941 7f0478950630 [contrail-schema] [INFO]: Session Event: TCP Connected 01/20/2025 01:58:57.941 7f0478950630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:58:57.941 7f0478950630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:58:57.941 7f0478950630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.22:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.22:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:58:57.941 7f0478950630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:58:57.941 7f0478950630 [contrail-schema] [INFO]: Processing event[EvTcpConnected] in state[Connect] 01/20/2025 01:58:57.941 7f0478950630 [contrail-schema] [DEBUG]: Send sandesh control message. uve type count # 19 01/20/2025 01:58:57.942 7f0478950630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 01/20/2025 01:58:57.942 7f0478950630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:58:57.942 7f0478950630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:58:57.942 7f0478957ac8 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/20/2025 01:58:57.943 7f0478957ac8 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/20/2025 01:58:57.952 7f0478957978 [contrail-schema] [DEBUG]: Extracted sandesh length: 0000001017 01/20/2025 01:58:57.952 7f0478957978 [contrail-schema] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/20/2025 01:58:57.953 7f0479ede048 [contrail-schema] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 01/20/2025 01:58:57.953 7f0479ede048 [contrail-schema] [DEBUG]: Number of uve types in sandesh control message is 0 01/20/2025 01:58:57.953 7f0479ede048 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/20/2025 01:58:57.953 7f0479ede048 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 01:58:57.953 7f0479ede048 [contrail-schema] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 01/20/2025 01:58:57.954 7f0478957b70 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/20/2025 01:58:57.956 7f0478957b70 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID]