07/03/2025 00:46:11.092 7fdb1850d888 [contrail-schema] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 07/03/2025 00:46:11.092 7fdb1850d888 [contrail-schema] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 07/03/2025 00:46:11.092 7fdb1850d888 [contrail-schema] [INFO]: SANDESH: Flow Logging: [None] -> [False] 07/03/2025 00:46:11.092 7fdb1235e0f0 [contrail-schema] [INFO]: Processing event[EvStart] in state[none] 07/03/2025 00:46:11.093 7fdb1235e0f0 [contrail-schema] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 07/03/2025 00:46:11.093 7fdb1235e0f0 [contrail-schema] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 07/03/2025 00:46:11.094 7fdb1235e0f0 [contrail-schema] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 07/03/2025 00:46:11.094 7fdb1235e0f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:11.094 7fdb1235e0f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 07/03/2025 00:46:11.095 7fdb1235e0f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:11.095 7fdb1235e0f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:11.095 7fdb1235e0f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 07/03/2025 00:46:11.095 7fdb1235e0f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:11.289 7fdb1850d888 [contrail-schema] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.41:5673//', 'pyamqp://guest:guest@10.0.0.27:5673//', 'pyamqp://guest:guest@10.0.0.23:5673//'] 07/03/2025 00:46:11.301 7fdb1850d888 [contrail-schema] [WARNING]: RabbitMQ drainer connection down 07/03/2025 00:46:11.301 7fdb11f42630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:11.304 7fdb11f42630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 07/03/2025 00:46:11.304 7fdb11f42630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:11.304 7fdb11f42630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:11.304 7fdb11f42630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 07/03/2025 00:46:11.304 7fdb11f42630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:15.094 7fdb11f424e0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:15.095 7fdb11f424e0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:15.095 7fdb11f424e0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:15.095 7fdb11f424e0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:15.095 7fdb11f424e0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 07/03/2025 00:46:15.095 7fdb11f424e0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:15.095 7fdb11f424e0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:15.096 7fdb11f424e0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:15.096 7fdb11f424e0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:15.096 7fdb11f424e0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 07/03/2025 00:46:15.096 7fdb11f424e0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:15.096 7fdb11f424e0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:15.096 7fdb11f424e0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:15.096 7fdb11f424e0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:19.097 7fdb11eab390 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:19.098 7fdb11eab390 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:19.099 7fdb11eab390 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:19.099 7fdb11eab390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:19.099 7fdb11eab390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 07/03/2025 00:46:19.099 7fdb11eab390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:19.099 7fdb11eab390 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:19.099 7fdb11eab390 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:19.100 7fdb11eab390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:19.100 7fdb11eab390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 07/03/2025 00:46:19.100 7fdb11eab390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:19.100 7fdb11eab390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:19.100 7fdb11eab390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:19.100 7fdb11eab390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:23.100 7fdb11eab390 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:23.102 7fdb11eab390 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:23.102 7fdb11eab390 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:23.102 7fdb11eab390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:23.102 7fdb11eab390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 07/03/2025 00:46:23.102 7fdb11eab390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:23.102 7fdb11eab390 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:23.103 7fdb11eab390 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:23.103 7fdb11eab390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:23.103 7fdb11eab390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 07/03/2025 00:46:23.103 7fdb11eab390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:23.103 7fdb11eab390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:23.103 7fdb11eab390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:23.103 7fdb11eab390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:23.339 7fdb1850d888 [contrail-schema] [WARNING]: RabbitMQ drainer connection ESTABLISHED 07/03/2025 00:46:23.340 7fdb11eaff60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:23.340 7fdb11eaff60 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:23.340 7fdb11eaff60 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:23.358 7fdb1850d888 [contrail-schema] [WARNING]: RabbitMQ publish connection down 07/03/2025 00:46:23.358 7fdb11e08e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:23.361 7fdb11e08e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 07/03/2025 00:46:23.361 7fdb11e08e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:23.366 7fdb1850d888 [contrail-schema] [WARNING]: RabbitMQ publish connection ESTABLISHED 07/03/2025 00:46:23.369 7fdb16d386d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:23.372 7fdb16d386d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:23.372 7fdb16d386d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:23.484 7fdb1850d888 [contrail-schema] [DEBUG]: Removed remained AMQP queue 07/03/2025 00:46:23.485 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:23.486 7fdb11eab8d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Zookeeper:Zookeeper[] connection down >>, ] >> 07/03/2025 00:46:23.486 7fdb11eab8d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:23.493 7fdb1850d888 [contrail-schema] [WARNING]: Waiting to be elected as master... 07/03/2025 00:46:23.493 7fdb11eab978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:23.493 7fdb11eab978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:23.493 7fdb11eab978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:27.103 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:27.104 7fdb11eab8d0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:27.104 7fdb11eab8d0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:27.104 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:27.104 7fdb11eab8d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:46:27.104 7fdb11eab8d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:27.104 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:27.105 7fdb11eab8d0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:27.105 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:27.105 7fdb11eab8d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:27.105 7fdb11eab8d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:27.105 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:27.105 7fdb11eab8d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:27.105 7fdb11eab8d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:31.107 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:31.108 7fdb11eab8d0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:31.108 7fdb11eab8d0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:31.108 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:31.108 7fdb11eab8d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:46:31.108 7fdb11eab8d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:31.109 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:31.109 7fdb11eab8d0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:31.109 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:31.109 7fdb11eab8d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:31.109 7fdb11eab8d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:31.109 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:31.109 7fdb11eab8d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:31.109 7fdb11eab8d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:35.111 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:35.112 7fdb11eab8d0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:35.112 7fdb11eab8d0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:35.112 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:35.112 7fdb11eab8d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:46:35.112 7fdb11eab8d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:35.113 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:35.113 7fdb11eab8d0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:35.113 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:35.113 7fdb11eab8d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:35.113 7fdb11eab8d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:35.113 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:35.113 7fdb11eab8d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:35.113 7fdb11eab8d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:39.115 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:39.116 7fdb11eab8d0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:39.116 7fdb11eab8d0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:39.116 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:39.116 7fdb11eab8d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:46:39.116 7fdb11eab8d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:39.116 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:39.116 7fdb11eab8d0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:39.117 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:39.117 7fdb11eab8d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:39.117 7fdb11eab8d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:39.117 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:39.117 7fdb11eab8d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:39.117 7fdb11eab8d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:43.119 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:43.120 7fdb11eab8d0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:43.121 7fdb11eab8d0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:43.121 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:43.121 7fdb11eab8d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:46:43.121 7fdb11eab8d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:43.121 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:43.121 7fdb11eab8d0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:43.121 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:43.122 7fdb11eab8d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:43.122 7fdb11eab8d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:43.122 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:43.122 7fdb11eab8d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:43.122 7fdb11eab8d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:47.123 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:47.124 7fdb11eab8d0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:47.124 7fdb11eab8d0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:47.124 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:47.125 7fdb11eab8d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:46:47.125 7fdb11eab8d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:47.125 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:47.125 7fdb11eab8d0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:47.125 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:47.125 7fdb11eab8d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:47.125 7fdb11eab8d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:47.125 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:47.125 7fdb11eab8d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:47.125 7fdb11eab8d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:51.126 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:51.127 7fdb11eab8d0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:51.127 7fdb11eab8d0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:51.127 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:51.127 7fdb11eab8d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:46:51.127 7fdb11eab8d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:51.128 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:51.128 7fdb11eab8d0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:51.128 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:51.128 7fdb11eab8d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:51.128 7fdb11eab8d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:51.128 7fdb11eab8d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:51.128 7fdb11eab8d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:51.128 7fdb11eab8d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:55.131 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:55.132 7fdb11ee9390 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:55.132 7fdb11ee9390 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:55.132 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:55.132 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:46:55.133 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:55.133 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:55.133 7fdb11ee9390 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:55.133 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:55.133 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:55.133 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:55.133 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:55.133 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:55.133 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:59.135 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:59.136 7fdb11ee9390 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:59.136 7fdb11ee9390 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:59.136 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:59.136 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:46:59.137 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:59.137 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:59.137 7fdb11ee9390 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:59.137 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:59.138 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:59.138 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:59.138 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:59.138 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:59.138 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:03.137 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:03.138 7fdb11ee9390 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:03.138 7fdb11ee9390 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:03.138 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:03.138 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:03.138 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:03.138 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:03.139 7fdb11ee9390 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:03.139 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:03.139 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:03.139 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:03.139 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:03.139 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:03.139 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:07.139 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:07.140 7fdb11ee9390 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:07.141 7fdb11ee9390 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:07.141 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:07.141 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:07.141 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:07.141 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:07.141 7fdb11ee9390 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:07.141 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:07.141 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:07.141 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:07.141 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:07.142 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:07.142 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:11.143 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:11.144 7fdb11ee9390 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:11.144 7fdb11ee9390 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:11.144 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:11.144 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:11.144 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:11.145 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:11.145 7fdb11ee9390 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:11.145 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:11.145 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:11.145 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:11.145 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:11.145 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:11.145 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:15.146 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:15.147 7fdb11ee9390 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:15.148 7fdb11ee9390 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:15.148 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:15.148 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:15.148 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:15.148 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:15.148 7fdb11ee9390 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:15.148 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:15.149 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:15.149 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:15.149 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:15.149 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:15.149 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:19.151 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:19.152 7fdb11ee9390 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:19.153 7fdb11ee9390 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:19.153 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:19.153 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:19.153 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:19.153 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:19.153 7fdb11ee9390 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:19.153 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:19.154 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:19.154 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:19.154 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:19.154 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:19.154 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:23.157 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:23.158 7fdb11ee9390 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:23.159 7fdb11ee9390 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:23.159 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:23.159 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:23.159 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:23.159 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:23.160 7fdb11ee9390 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:23.160 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:23.160 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:23.160 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:23.160 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:23.160 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:23.160 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:27.163 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:27.164 7fdb11ee9390 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:27.164 7fdb11ee9390 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:27.164 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:27.164 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:27.165 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:27.165 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:27.165 7fdb11ee9390 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:27.165 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:27.165 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:27.165 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:27.165 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:27.165 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:27.165 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:31.165 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:31.167 7fdb11ee9390 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:31.167 7fdb11ee9390 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:31.167 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:31.167 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:31.167 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:31.167 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:31.168 7fdb11ee9390 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:31.168 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:31.168 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:31.168 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:31.168 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:31.168 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:31.168 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:35.171 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:35.173 7fdb11ee9390 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:35.173 7fdb11ee9390 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:35.173 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:35.173 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:35.174 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:35.174 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:35.174 7fdb11ee9390 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:35.174 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:35.174 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:35.174 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:35.174 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:35.175 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:35.175 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:39.175 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:39.176 7fdb11ee9390 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:39.177 7fdb11ee9390 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:39.177 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:39.177 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:39.177 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:39.177 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:39.177 7fdb11ee9390 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:39.177 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:39.177 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:39.177 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:39.177 7fdb11ee9390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:39.178 7fdb11ee9390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:39.178 7fdb11ee9390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:43.178 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:43.179 7fdb11d38978 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:43.179 7fdb11d38978 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:43.179 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:43.179 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:43.180 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:43.180 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:43.180 7fdb11d38978 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:43.180 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:43.180 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:43.180 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:43.180 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:43.180 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:43.181 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:47.181 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:47.182 7fdb11d38978 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:47.183 7fdb11d38978 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:47.183 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:47.183 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:47.183 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:47.183 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:47.183 7fdb11d38978 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:47.183 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:47.183 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:47.184 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:47.184 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:47.184 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:47.184 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:51.187 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:51.188 7fdb11d38978 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:51.188 7fdb11d38978 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:51.188 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:51.189 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:51.189 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:51.189 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:51.189 7fdb11d38978 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:51.189 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:51.189 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:51.189 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:51.189 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:51.189 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:51.190 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:55.192 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:55.194 7fdb11d38978 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:55.194 7fdb11d38978 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:55.194 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:55.194 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:55.194 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:55.194 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:55.195 7fdb11d38978 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:55.195 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:55.195 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:55.195 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:55.195 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:55.195 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:55.195 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:59.198 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:59.200 7fdb11d38978 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:59.200 7fdb11d38978 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:59.200 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:59.200 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:59.201 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:59.201 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:59.201 7fdb11d38978 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:59.201 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:59.201 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:59.201 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:59.201 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:59.201 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:59.201 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:03.203 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:48:03.204 7fdb11d38978 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:48:03.204 7fdb11d38978 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:48:03.204 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:03.204 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:48:03.204 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:03.204 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:48:03.205 7fdb11d38978 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:48:03.205 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:03.205 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:48:03.205 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:03.205 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:03.205 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:48:03.205 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:07.207 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:48:07.208 7fdb11d38978 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:48:07.208 7fdb11d38978 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:48:07.208 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:07.208 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:48:07.209 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:07.209 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:48:07.209 7fdb11d38978 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:48:07.209 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:07.209 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:48:07.209 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:07.209 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:07.209 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:48:07.210 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:11.211 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:48:11.212 7fdb11d38978 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:48:11.212 7fdb11d38978 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:48:11.212 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:11.212 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:48:11.213 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:11.213 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:48:11.213 7fdb11d38978 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:48:11.213 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:11.213 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:48:11.213 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:11.213 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:11.213 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:48:11.213 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:15.217 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:48:15.218 7fdb11d38978 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:48:15.218 7fdb11d38978 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:48:15.218 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:15.218 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:48:15.218 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:15.218 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:48:15.218 7fdb11d38978 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:48:15.219 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:15.219 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:48:15.219 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:15.219 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:15.219 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:48:15.219 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:19.219 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:48:19.220 7fdb11d38978 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:48:19.220 7fdb11d38978 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:48:19.221 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:19.221 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:48:19.221 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:19.221 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:48:19.221 7fdb11d38978 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:48:19.221 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:19.221 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:48:19.221 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:19.221 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:19.221 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:48:19.222 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:23.222 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:48:23.224 7fdb11d38978 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:48:23.224 7fdb11d38978 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:48:23.224 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:23.224 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:48:23.224 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:23.224 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:48:23.224 7fdb11d38978 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:48:23.225 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:23.225 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:48:23.225 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:23.225 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:23.225 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:48:23.225 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:27.228 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:48:27.229 7fdb11d38978 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:48:27.229 7fdb11d38978 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:48:27.229 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:27.230 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:48:27.230 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:27.230 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:48:27.230 7fdb11d38978 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:48:27.230 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:27.230 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:48:27.230 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:27.230 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:27.230 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:48:27.230 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:31.232 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:48:31.234 7fdb11d38978 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:48:31.234 7fdb11d38978 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:48:31.234 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:31.235 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:48:31.235 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:31.235 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:48:31.235 7fdb11d38978 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:48:31.235 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:31.236 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:48:31.236 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:31.236 7fdb11d38978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:31.236 7fdb11d38978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571093889 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.41:8086, 10.0.0.23:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:48:31.236 7fdb11d38978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:35.235 7fdb11ee94e0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:48:35.237 7fdb11ee94e0 [contrail-schema] [INFO]: Session Event: TCP Connected 07/03/2025 00:48:35.237 7fdb11ee94e0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:48:35.237 7fdb11ee94e0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:35.237 7fdb11ee94e0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:48:35.237 7fdb11ee94e0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:35.237 7fdb11ee94e0 [contrail-schema] [INFO]: Processing event[EvTcpConnected] in state[Connect] 07/03/2025 00:48:35.237 7fdb11ee94e0 [contrail-schema] [DEBUG]: Send sandesh control message. uve type count # 19 07/03/2025 00:48:35.238 7fdb11ee94e0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 07/03/2025 00:48:35.238 7fdb11ee94e0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 07/03/2025 00:48:35.238 7fdb11ee94e0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 07/03/2025 00:48:35.238 7fdb11ee9780 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 07/03/2025 00:48:35.240 7fdb11ee9780 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 07/03/2025 00:48:46.423 7fdb11ee9c18 [contrail-schema] [DEBUG]: Extracted sandesh length: 0000001016 07/03/2025 00:48:46.424 7fdb11ee9c18 [contrail-schema] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 07/03/2025 00:48:46.424 7fdb15f0feb8 [contrail-schema] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 07/03/2025 00:48:46.424 7fdb15f0feb8 [contrail-schema] [DEBUG]: Number of uve types in sandesh control message is 0 07/03/2025 00:48:46.425 7fdb15f0feb8 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 07/03/2025 00:48:46.425 7fdb15f0feb8 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 07/03/2025 00:48:46.425 7fdb15f0feb8 [contrail-schema] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 07/03/2025 00:48:46.425 7fdb12352cc0 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 07/03/2025 00:48:46.426 7fdb12352cc0 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 07/03/2025 00:48:56.417 7fdb11ee9c18 [contrail-schema] [DEBUG]: Extracted sandesh length: 0000001296 07/03/2025 00:48:56.418 7fdb11ee9c18 [contrail-schema] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 07/03/2025 00:48:56.419 7fdb15f0feb8 [contrail-schema] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 07/03/2025 00:48:56.419 7fdb15f0feb8 [contrail-schema] [DEBUG]: Number of uve types in sandesh control message is 2 07/03/2025 00:48:56.419 7fdb15f0feb8 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 07/03/2025 00:48:56.419 7fdb15f0feb8 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map