03/09/2026 04:59:24.061 7f8a3f5cce88 [contrail-device-manager] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 03/09/2026 04:59:24.061 7f8a3f5cce88 [contrail-device-manager] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 03/09/2026 04:59:24.062 7f8a3f5cce88 [contrail-device-manager] [INFO]: SANDESH: Flow Logging: [None] -> [False] 03/09/2026 04:59:24.062 7f8a36c0e048 [contrail-device-manager] [INFO]: Processing event[EvStart] in state[none] 03/09/2026 04:59:24.062 7f8a36c0e048 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 03/09/2026 04:59:24.063 7f8a36c0e048 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/09/2026 04:59:24.063 7f8a36c0e048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 03/09/2026 04:59:24.063 7f8a36c0e048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:24.063 7f8a36c0e048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/09/2026 04:59:24.064 7f8a36c0e048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:24.064 7f8a36c0e048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:24.064 7f8a36c0e048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 start_time = 1773032364063259 collector_name = collector_ip = collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 03/09/2026 04:59:24.064 7f8a36c0e048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:24.118 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.38:5673//', 'pyamqp://guest:guest@10.0.0.50:5673//', 'pyamqp://guest:guest@10.0.0.33:5673//'] 03/09/2026 04:59:24.126 7f8a3f5cce88 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 03/09/2026 04:59:24.127 7f8a36b442e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:24.127 7f8a36b442e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/09/2026 04:59:24.127 7f8a36b442e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:24.127 7f8a36b442e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:24.127 7f8a36b442e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/09/2026 04:59:24.127 7f8a36b442e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:24.131 7f8a3f5cce88 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 03/09/2026 04:59:24.131 7f8a36b442e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:24.131 7f8a36b442e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/09/2026 04:59:24.131 7f8a36b442e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:24.159 7f8a3f5cce88 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 03/09/2026 04:59:24.160 7f8a36b45390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:24.160 7f8a36b45390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/09/2026 04:59:24.160 7f8a36b45390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:24.164 7f8a3f5cce88 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 03/09/2026 04:59:24.164 7f8a4540e978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:24.164 7f8a4540e978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/09/2026 04:59:24.164 7f8a4540e978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:24.184 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Removed remaining AMQP queue from previous run 03/09/2026 04:59:24.184 7f8a3f5cce88 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 03/09/2026 04:59:24.184 7f8a3f5cce88 [contrail-device-manager] [WARNING]: initializing cassandra cluster 03/09/2026 04:59:24.185 7f8a3f5cce88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 03/09/2026 04:59:24.185 7f8a45368630 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting consumer greenlet 03/09/2026 04:59:24.185 7f8a45368630 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 03/09/2026 04:59:24.185 7f8a36b45438 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting publisher greenlet 03/09/2026 04:59:24.185 7f8a36b45438 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Publisher connection 03/09/2026 04:59:24.186 7f8a369f8048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:24.186 7f8a369f8048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 03/09/2026 04:59:24.186 7f8a369f8048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:24.189 7f8a3f5cce88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 03/09/2026 04:59:24.193 7f8a45368630 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 03/09/2026 04:59:24.194 7f8a45368630 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Waiting for consumer 03/09/2026 04:59:24.194 7f8a36b45438 [contrail-device-manager] [INFO]: KombuAmqpClient: Publisher connection established 03/09/2026 04:59:24.230 7f8a3f5cce88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 03/09/2026 04:59:24.231 7f8a369cb2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:24.232 7f8a369cb2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 03/09/2026 04:59:24.232 7f8a369cb2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:24.243 7f8a3f5cce88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 03/09/2026 04:59:24.243 7f8a36913a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:24.243 7f8a36913a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 03/09/2026 04:59:24.243 7f8a36913a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:25.251 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Waiting for keyspace config_db_uuid to be created 03/09/2026 04:59:25.258 7f8a3f5cce88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 03/09/2026 04:59:25.279 7f8a3f5cce88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 03/09/2026 04:59:26.720 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 03/09/2026 04:59:27.693 7f8a3f5cce88 [contrail-device-manager] [WARNING]: table 'obj_uuid_table', created 03/09/2026 04:59:27.698 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 03/09/2026 04:59:28.064 7f8a368f62e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 04:59:28.065 7f8a368f62e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 04:59:28.065 7f8a368f62e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 04:59:28.065 7f8a368f62e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 04:59:28.065 7f8a368f62e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/09/2026 04:59:28.065 7f8a368f62e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 04:59:28.065 7f8a368f62e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 04:59:28.066 7f8a368f62e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 04:59:28.066 7f8a368f62e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:28.066 7f8a368f62e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/09/2026 04:59:28.066 7f8a368f62e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:28.066 7f8a368f62e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:28.066 7f8a368f62e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 04:59:28.066 7f8a368f62e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:28.805 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 03/09/2026 04:59:29.531 7f8a3f5cce88 [contrail-device-manager] [WARNING]: table 'obj_uuid_table' fixed with properties {'gc_grace_seconds': 864000} 03/09/2026 04:59:29.537 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 03/09/2026 04:59:31.595 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 03/09/2026 04:59:32.065 7f8a368cce10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 04:59:32.067 7f8a368cce10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 04:59:32.067 7f8a368cce10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 04:59:32.067 7f8a368cce10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 04:59:32.067 7f8a368cce10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/09/2026 04:59:32.067 7f8a368cce10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 04:59:32.067 7f8a368cce10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 04:59:32.068 7f8a368cce10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 04:59:32.068 7f8a368cce10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:32.068 7f8a368cce10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/09/2026 04:59:32.068 7f8a368cce10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:32.068 7f8a368cce10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:32.068 7f8a368cce10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 04:59:32.068 7f8a368cce10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:32.713 7f8a3f5cce88 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table', created 03/09/2026 04:59:32.718 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 03/09/2026 04:59:34.729 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 03/09/2026 04:59:35.647 7f8a3f5cce88 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table' fixed with properties {'gc_grace_seconds': 864000} 03/09/2026 04:59:35.652 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 03/09/2026 04:59:36.068 7f8a368db240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 04:59:36.069 7f8a368db240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 04:59:36.069 7f8a368db240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 04:59:36.069 7f8a368db240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 04:59:36.070 7f8a368db240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/09/2026 04:59:36.070 7f8a368db240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 04:59:36.070 7f8a368db240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 04:59:36.070 7f8a368db240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 04:59:36.070 7f8a368db240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:36.070 7f8a368db240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/09/2026 04:59:36.071 7f8a368db240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:36.071 7f8a368db240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:36.071 7f8a368db240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 04:59:36.071 7f8a368db240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:37.642 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 03/09/2026 04:59:37.648 7f8a3f5cce88 [contrail-device-manager] [WARNING]: table 'obj_shared_table', created 03/09/2026 04:59:37.652 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 03/09/2026 04:59:39.777 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 03/09/2026 04:59:40.070 7f8a36913240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 04:59:40.071 7f8a36913240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 04:59:40.071 7f8a36913240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 04:59:40.071 7f8a36913240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 04:59:40.071 7f8a36913240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/09/2026 04:59:40.071 7f8a36913240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 04:59:40.071 7f8a36913240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 04:59:40.072 7f8a36913240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 04:59:40.072 7f8a36913240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:40.072 7f8a36913240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/09/2026 04:59:40.072 7f8a36913240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:40.072 7f8a36913240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:40.072 7f8a36913240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 04:59:40.072 7f8a36913240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:40.265 7f8a3f5cce88 [contrail-device-manager] [WARNING]: table 'obj_shared_table' fixed with properties {'gc_grace_seconds': 864000} 03/09/2026 04:59:40.270 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 03/09/2026 04:59:40.270 7f8a368c8b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:40.270 7f8a368c8b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 04:59:40.271 7f8a368c8b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:40.309 7f8a3f5cce88 [contrail-device-manager] [ERROR]: Error in db walk read 'type' 03/09/2026 04:59:40.309 7f8a3606dc18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:40.310 7f8a3606dc18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Zookeeper:Zookeeper[] connection down >>, ] >> 03/09/2026 04:59:40.310 7f8a3606dc18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:40.320 7f8a368ec4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:40.321 7f8a368ec4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 04:59:40.321 7f8a368ec4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:40.321 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_status_consumer.dummy 03/09/2026 04:59:40.321 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_request_consumer 03/09/2026 04:59:40.321 7f8a45368630 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 03/09/2026 04:59:40.322 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-5456-2. 03/09/2026 04:59:40.328 7f8a45368630 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 03/09/2026 04:59:40.495 7f8a45368630 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-5456-2.'] 03/09/2026 04:59:40.618 7f8a45368630 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 03/09/2026 04:59:40.623 7f8a45368630 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 03/09/2026 04:59:40.663 7f8a45368630 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-5456-2.'] 03/09/2026 04:59:40.831 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Fetching all containers 03/09/2026 04:59:40.897 7f8a3f5cce88 [contrail-device-manager] [INFO]: Restarting dnsmasq docker: config_dnsmasq_1 03/09/2026 04:59:41.059 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-5456-2..config_queue 03/09/2026 04:59:41.059 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-5456-2..tftp_queue 03/09/2026 04:59:41.560 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Process 138 prepared to run in Full mode... 03/09/2026 04:59:41.560 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Elected master Device Manager node. Initializing... 03/09/2026 04:59:41.560 7f8a3f5cce88 [contrail-device-manager] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8096 03/09/2026 04:59:41.565 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add [config_updater.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/config_updater] to home page 03/09/2026 04:59:41.565 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_ConfigApiUpdateReq] 03/09/2026 04:59:41.567 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add [greenlets.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/greenlets] to home page 03/09/2026 04:59:41.567 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_GreenletObjectReq] 03/09/2026 04:59:41.569 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add [cpuinfo.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/nodeinfo/cpuinfo] to home page 03/09/2026 04:59:41.569 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CpuLoadInfoReq] 03/09/2026 04:59:41.573 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add [dm_introspect.xml:/usr/lib/python3.6/site-packages/device_manager/sandesh/dm_introspect] to home page 03/09/2026 04:59:41.573 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_RoutingInstanceList] 03/09/2026 04:59:41.573 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualNetworkList] 03/09/2026 04:59:41.573 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualMachineInterfaceList] 03/09/2026 04:59:41.573 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalInterfaceList] 03/09/2026 04:59:41.573 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalInterfaceList] 03/09/2026 04:59:41.574 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalRouterList] 03/09/2026 04:59:41.574 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_BgpRouterList] 03/09/2026 04:59:41.574 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalRouterList] 03/09/2026 04:59:41.574 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_InstanceIpList] 03/09/2026 04:59:41.574 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FloatingIpList] 03/09/2026 04:59:41.574 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PortTupleList] 03/09/2026 04:59:41.574 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FeatureFlagList] 03/09/2026 04:59:41.576 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add [sandesh_alarm.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_alarm] to home page 03/09/2026 04:59:41.576 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmCacheRequest] 03/09/2026 04:59:41.576 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmTypesRequest] 03/09/2026 04:59:41.576 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmAckRequest] 03/09/2026 04:59:41.576 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add [sandesh_ctrl.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_ctrl] to home page 03/09/2026 04:59:41.577 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlClientToServer] 03/09/2026 04:59:41.577 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlServerToClient] 03/09/2026 04:59:41.577 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add [sandesh_trace.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_trace] to home page 03/09/2026 04:59:41.577 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceRequest] 03/09/2026 04:59:41.577 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferListRequest] 03/09/2026 04:59:41.577 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceEnableDisableReq] 03/09/2026 04:59:41.578 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufStatusReq] 03/09/2026 04:59:41.578 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferEnableDisableReq] 03/09/2026 04:59:41.578 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add [sandesh_uve.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_uve] to home page 03/09/2026 04:59:41.579 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshMessageStatsReq] 03/09/2026 04:59:41.579 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsSet] 03/09/2026 04:59:41.579 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsStatus] 03/09/2026 04:59:41.579 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsSet] 03/09/2026 04:59:41.579 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsStatus] 03/09/2026 04:59:41.579 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsSet] 03/09/2026 04:59:41.579 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsReset] 03/09/2026 04:59:41.579 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsStatus] 03/09/2026 04:59:41.579 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueSet] 03/09/2026 04:59:41.579 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueStatus] 03/09/2026 04:59:41.579 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CollectorInfoRequest] 03/09/2026 04:59:41.579 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVEDSConfReq] 03/09/2026 04:59:41.580 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVECacheReq] 03/09/2026 04:59:41.580 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVETypesReq] 03/09/2026 04:59:41.582 7f8a3f5cce88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.ztp_queue 03/09/2026 04:59:41.598 7f8a35fc64e0 [contrail-device-manager] [ERROR]: Cannot write http_port 8096 to /tmp/contrail-device-manager.1.http_port 03/09/2026 04:59:41.598 7f8a35fc64e0 [contrail-device-manager] [ERROR]: Starting Introspect on HTTP Port 8096 03/09/2026 04:59:41.753 7f8a35801d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:41.753 7f8a35801d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Initializing description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 03/09/2026 04:59:41.753 7f8a35801d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:41.770 7f8a356de2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:41.771 7f8a356de2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 03/09/2026 04:59:41.771 7f8a356de2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:41.775 7f8a45368630 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 03/09/2026 04:59:41.781 7f8a45368630 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 03/09/2026 04:59:42.058 7f8a45368630 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-5456-2.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-5456-2..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-5456-2..tftp_queue', 'device_manager_ztp.ztp_queue'] 03/09/2026 04:59:44.071 7f8a356ecf60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 04:59:44.073 7f8a356ecf60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 04:59:44.073 7f8a356ecf60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 04:59:44.073 7f8a356ecf60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 04:59:44.073 7f8a356ecf60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 03/09/2026 04:59:44.074 7f8a356ecf60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 04:59:44.074 7f8a356ecf60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 04:59:44.074 7f8a356ecf60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 04:59:44.074 7f8a356ecf60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:44.074 7f8a356ecf60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 03/09/2026 04:59:44.075 7f8a356ecf60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:44.075 7f8a356ecf60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:44.075 7f8a356ecf60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 04:59:44.075 7f8a356ecf60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:47.923 7f8a356942e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:47.923 7f8a356942e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 04:59:47.923 7f8a356942e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:48.073 7f8a3560f048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 04:59:48.074 7f8a3560f048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 04:59:48.074 7f8a3560f048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 04:59:48.075 7f8a3560f048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 04:59:48.075 7f8a3560f048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/09/2026 04:59:48.075 7f8a3560f048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 04:59:48.075 7f8a3560f048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 04:59:48.075 7f8a3560f048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 04:59:48.075 7f8a3560f048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:48.075 7f8a3560f048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 04:59:48.075 7f8a3560f048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:48.075 7f8a3560f048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:48.075 7f8a3560f048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 04:59:48.075 7f8a3560f048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:52.075 7f8a368c0d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 04:59:52.077 7f8a368c0d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 04:59:52.077 7f8a368c0d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 04:59:52.077 7f8a368c0d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 04:59:52.077 7f8a368c0d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/09/2026 04:59:52.077 7f8a368c0d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 04:59:52.077 7f8a368c0d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 04:59:52.078 7f8a368c0d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 04:59:52.079 7f8a368c0d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:52.079 7f8a368c0d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 04:59:52.079 7f8a368c0d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:52.079 7f8a368c0d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:52.079 7f8a368c0d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 04:59:52.079 7f8a368c0d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:56.077 7f8a35599588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 04:59:56.079 7f8a35599588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 04:59:56.079 7f8a35599588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 04:59:56.079 7f8a35599588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 04:59:56.079 7f8a35599588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/09/2026 04:59:56.079 7f8a35599588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 04:59:56.079 7f8a35599588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 04:59:56.079 7f8a35599588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 04:59:56.080 7f8a35599588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:56.080 7f8a35599588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 04:59:56.080 7f8a35599588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:56.080 7f8a35599588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 04:59:56.080 7f8a35599588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 04:59:56.080 7f8a35599588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:00.079 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 05:00:00.080 7f8a3e13e4e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 05:00:00.080 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 05:00:00.080 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:00:00.080 7f8a3e13e4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/09/2026 05:00:00.080 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:00:00.081 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 05:00:00.081 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 05:00:00.081 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:00.081 7f8a3e13e4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 05:00:00.081 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:00.081 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:00.081 7f8a3e13e4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 05:00:00.081 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:04.082 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 05:00:04.083 7f8a3e13e4e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 05:00:04.084 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 05:00:04.084 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:00:04.084 7f8a3e13e4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/09/2026 05:00:04.084 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:00:04.084 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 05:00:04.084 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 05:00:04.084 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:04.084 7f8a3e13e4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 05:00:04.085 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:04.085 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:04.085 7f8a3e13e4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 05:00:04.085 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:08.086 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 05:00:08.087 7f8a3e13e4e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 05:00:08.087 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 05:00:08.087 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:00:08.087 7f8a3e13e4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/09/2026 05:00:08.087 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:00:08.087 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 05:00:08.088 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 05:00:08.088 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:08.088 7f8a3e13e4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 05:00:08.088 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:08.088 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:08.088 7f8a3e13e4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 05:00:08.088 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:12.089 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 05:00:12.090 7f8a3e13e4e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 05:00:12.090 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 05:00:12.090 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:00:12.090 7f8a3e13e4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/09/2026 05:00:12.090 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:00:12.090 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 05:00:12.090 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 05:00:12.091 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:12.091 7f8a3e13e4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 05:00:12.091 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:12.091 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:12.091 7f8a3e13e4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 05:00:12.091 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:16.091 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 05:00:16.092 7f8a3e13e4e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 05:00:16.093 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 05:00:16.093 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:00:16.093 7f8a3e13e4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/09/2026 05:00:16.093 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:00:16.093 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 05:00:16.094 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 05:00:16.094 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:16.094 7f8a3e13e4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 05:00:16.094 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:16.094 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:16.094 7f8a3e13e4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 05:00:16.094 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:20.093 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 05:00:20.095 7f8a3e13e4e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 05:00:20.095 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 05:00:20.095 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:00:20.095 7f8a3e13e4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/09/2026 05:00:20.095 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:00:20.095 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 05:00:20.096 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 05:00:20.096 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:20.096 7f8a3e13e4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 05:00:20.096 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:20.096 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:20.096 7f8a3e13e4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 05:00:20.096 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:24.096 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 05:00:24.097 7f8a3e13e4e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 05:00:24.097 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 05:00:24.097 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:00:24.098 7f8a3e13e4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/09/2026 05:00:24.098 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:00:24.098 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 05:00:24.098 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 05:00:24.098 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:24.098 7f8a3e13e4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 05:00:24.098 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:24.098 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:24.098 7f8a3e13e4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 05:00:24.098 7f8a3e13e4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:28.098 7f8a368cc978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 05:00:28.100 7f8a368cc978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 05:00:28.100 7f8a368cc978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 05:00:28.100 7f8a368cc978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:00:28.100 7f8a368cc978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/09/2026 05:00:28.100 7f8a368cc978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:00:28.100 7f8a368cc978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 05:00:28.101 7f8a368cc978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 05:00:28.101 7f8a368cc978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:28.101 7f8a368cc978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 05:00:28.101 7f8a368cc978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:28.101 7f8a368cc978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:28.101 7f8a368cc978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 05:00:28.101 7f8a368cc978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:32.101 7f8a368cc978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 05:00:32.102 7f8a368cc978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 05:00:32.102 7f8a368cc978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 05:00:32.103 7f8a368cc978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:00:32.103 7f8a368cc978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/09/2026 05:00:32.103 7f8a368cc978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:00:32.103 7f8a368cc978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 05:00:32.103 7f8a368cc978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 05:00:32.103 7f8a368cc978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:32.103 7f8a368cc978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 05:00:32.103 7f8a368cc978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:32.103 7f8a368cc978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:32.103 7f8a368cc978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 05:00:32.103 7f8a368cc978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:36.103 7f8a355ac0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 05:00:36.107 7f8a355ac0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 05:00:36.107 7f8a355ac0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 05:00:36.107 7f8a355ac0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:00:36.107 7f8a355ac0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/09/2026 05:00:36.107 7f8a355ac0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:00:36.107 7f8a355ac0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 05:00:36.108 7f8a355ac0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 05:00:36.108 7f8a355ac0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:36.108 7f8a355ac0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 05:00:36.108 7f8a355ac0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:36.108 7f8a355ac0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:36.108 7f8a355ac0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 05:00:36.108 7f8a355ac0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:40.108 7f8a36902828 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 05:00:40.109 7f8a36902828 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 05:00:40.109 7f8a36902828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 05:00:40.109 7f8a36902828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:00:40.109 7f8a36902828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/09/2026 05:00:40.109 7f8a36902828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:00:40.109 7f8a36902828 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 05:00:40.110 7f8a36902828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 05:00:40.110 7f8a36902828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:40.110 7f8a36902828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 05:00:40.110 7f8a36902828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:40.110 7f8a36902828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:40.110 7f8a36902828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 05:00:40.110 7f8a36902828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:44.109 7f8a36913a20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 05:00:44.111 7f8a36913a20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 05:00:44.111 7f8a36913a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 05:00:44.111 7f8a36913a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:00:44.111 7f8a36913a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/09/2026 05:00:44.111 7f8a36913a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:00:44.112 7f8a36913a20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 05:00:44.112 7f8a36913a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 05:00:44.112 7f8a36913a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:44.112 7f8a36913a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 05:00:44.112 7f8a36913a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:44.113 7f8a36913a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:44.113 7f8a36913a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 05:00:44.113 7f8a36913a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:48.113 7f8a36913a20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 05:00:48.114 7f8a36913a20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 05:00:48.114 7f8a36913a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 05:00:48.114 7f8a36913a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:00:48.114 7f8a36913a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/09/2026 05:00:48.114 7f8a36913a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:00:48.114 7f8a36913a20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 05:00:48.115 7f8a36913a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 05:00:48.115 7f8a36913a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:48.115 7f8a36913a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 05:00:48.115 7f8a36913a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:48.115 7f8a36913a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:48.115 7f8a36913a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 05:00:48.115 7f8a36913a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:52.115 7f8a35666978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 05:00:52.116 7f8a35666978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 05:00:52.116 7f8a35666978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 05:00:52.116 7f8a35666978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:00:52.117 7f8a35666978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/09/2026 05:00:52.117 7f8a35666978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:00:52.117 7f8a35666978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 05:00:52.117 7f8a35666978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 05:00:52.117 7f8a35666978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:52.117 7f8a35666978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 05:00:52.117 7f8a35666978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:52.117 7f8a35666978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:52.118 7f8a35666978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 05:00:52.118 7f8a35666978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:56.117 7f8a368c26d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 05:00:56.118 7f8a368c26d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 05:00:56.118 7f8a368c26d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 05:00:56.118 7f8a368c26d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:00:56.118 7f8a368c26d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/09/2026 05:00:56.118 7f8a368c26d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:00:56.118 7f8a368c26d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 05:00:56.119 7f8a368c26d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 05:00:56.119 7f8a368c26d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:56.119 7f8a368c26d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 05:00:56.119 7f8a368c26d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:56.119 7f8a368c26d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:00:56.119 7f8a368c26d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 05:00:56.119 7f8a368c26d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:00.119 7f8a36c19d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 05:01:00.121 7f8a36c19d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 05:01:00.122 7f8a36c19d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 05:01:00.122 7f8a36c19d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:01:00.122 7f8a36c19d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/09/2026 05:01:00.122 7f8a36c19d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:01:00.122 7f8a36c19d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 05:01:00.122 7f8a36c19d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 05:01:00.122 7f8a36c19d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:00.122 7f8a36c19d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 05:01:00.123 7f8a36c19d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:00.123 7f8a36c19d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:00.123 7f8a36c19d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 05:01:00.123 7f8a36c19d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:04.122 7f8a3c65a048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 05:01:04.123 7f8a3c65a048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 05:01:04.124 7f8a3c65a048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 05:01:04.124 7f8a3c65a048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:01:04.124 7f8a3c65a048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/09/2026 05:01:04.124 7f8a3c65a048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:01:04.124 7f8a3c65a048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 05:01:04.125 7f8a3c65a048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 05:01:04.125 7f8a3c65a048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:04.125 7f8a3c65a048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 05:01:04.125 7f8a3c65a048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:04.125 7f8a3c65a048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:04.125 7f8a3c65a048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 05:01:04.126 7f8a3c65a048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:08.124 7f8a35666048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 05:01:08.125 7f8a35666048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 05:01:08.126 7f8a35666048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 05:01:08.126 7f8a35666048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:01:08.126 7f8a35666048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/09/2026 05:01:08.126 7f8a35666048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:01:08.126 7f8a35666048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 05:01:08.126 7f8a35666048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 05:01:08.126 7f8a35666048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:08.127 7f8a35666048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 05:01:08.127 7f8a35666048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:08.127 7f8a35666048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:08.127 7f8a35666048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 05:01:08.127 7f8a35666048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:08.742 7f8a3f5cce88 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 03/09/2026 05:01:08.743 7f8a3f5cce88 [contrail-device-manager] [WARNING]: initializing cassandra cluster 03/09/2026 05:01:08.743 7f8a3f5cce88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 03/09/2026 05:01:08.743 7f8a35666048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:08.743 7f8a35666048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/09/2026 05:01:08.743 7f8a35666048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:08.745 7f8a3f5cce88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 03/09/2026 05:01:08.789 7f8a3f5cce88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 03/09/2026 05:01:08.791 7f8a357bfac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:08.791 7f8a357bfac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Initializing description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 03/09/2026 05:01:08.792 7f8a357bfac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:08.798 7f8a3f5cce88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 03/09/2026 05:01:08.798 7f8a357bf978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:08.799 7f8a357bf978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/09/2026 05:01:08.799 7f8a357bf978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:08.815 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 03/09/2026 05:01:09.701 7f8a3f5cce88 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace', created 03/09/2026 05:01:09.805 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 03/09/2026 05:01:09.822 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 03/09/2026 05:01:10.607 7f8a3f5cce88 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None} 03/09/2026 05:01:10.614 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 03/09/2026 05:01:10.614 7f8a3f5cce88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 03/09/2026 05:01:10.709 7f8a3f5cce88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 03/09/2026 05:01:10.726 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 03/09/2026 05:01:11.854 7f8a3f5cce88 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table', created 03/09/2026 05:01:11.860 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 03/09/2026 05:01:11.867 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 03/09/2026 05:01:12.126 7f8a354e1a20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 05:01:12.127 7f8a354e1a20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 05:01:12.127 7f8a354e1a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 05:01:12.127 7f8a354e1a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:01:12.127 7f8a354e1a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/09/2026 05:01:12.127 7f8a354e1a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:01:12.127 7f8a354e1a20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 05:01:12.128 7f8a354e1a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 05:01:12.128 7f8a354e1a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:12.128 7f8a354e1a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/09/2026 05:01:12.128 7f8a354e1a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:12.128 7f8a354e1a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:12.128 7f8a354e1a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 05:01:12.128 7f8a354e1a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:12.662 7f8a3f5cce88 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table' fixed with properties {'gc_grace_seconds': 864000} 03/09/2026 05:01:12.674 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 03/09/2026 05:01:12.687 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 03/09/2026 05:01:13.573 7f8a3f5cce88 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table', created 03/09/2026 05:01:13.578 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 03/09/2026 05:01:13.592 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 03/09/2026 05:01:14.734 7f8a3f5cce88 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table' fixed with properties {'gc_grace_seconds': 864000} 03/09/2026 05:01:14.751 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 03/09/2026 05:01:14.760 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 03/09/2026 05:01:15.702 7f8a3f5cce88 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table', created 03/09/2026 05:01:15.711 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 03/09/2026 05:01:15.729 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 03/09/2026 05:01:16.128 7f8a354e6438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 05:01:16.130 7f8a354e6438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 05:01:16.130 7f8a354e6438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 05:01:16.130 7f8a354e6438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:01:16.131 7f8a354e6438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 03/09/2026 05:01:16.131 7f8a354e6438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:01:16.131 7f8a354e6438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 05:01:16.131 7f8a354e6438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 05:01:16.131 7f8a354e6438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:16.135 7f8a354e6438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 03/09/2026 05:01:16.135 7f8a354e6438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:16.135 7f8a354e6438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:16.136 7f8a354e6438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 05:01:16.136 7f8a354e6438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:16.631 7f8a3f5cce88 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table' fixed with properties {'gc_grace_seconds': 864000} 03/09/2026 05:01:16.636 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 03/09/2026 05:01:16.645 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 03/09/2026 05:01:17.832 7f8a3f5cce88 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table', created 03/09/2026 05:01:17.839 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 03/09/2026 05:01:17.847 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 03/09/2026 05:01:18.827 7f8a3f5cce88 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table' fixed with properties {'gc_grace_seconds': 864000} 03/09/2026 05:01:18.833 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 03/09/2026 05:01:18.833 7f8a355accc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:18.834 7f8a355accc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 05:01:18.834 7f8a355accc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:18.908 7f8a3f5cce88 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.38:5673//', 'pyamqp://guest:guest@10.0.0.50:5673//', 'pyamqp://guest:guest@10.0.0.33:5673//'] 03/09/2026 05:01:18.910 7f8a3f5cce88 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 03/09/2026 05:01:18.911 7f8a35540630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:18.911 7f8a35540630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Initializing description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 03/09/2026 05:01:18.911 7f8a35540630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:18.912 7f8a35540630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:18.912 7f8a35540630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 03/09/2026 05:01:18.912 7f8a35540630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:18.916 7f8a3f5cce88 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 03/09/2026 05:01:18.916 7f8a35540630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:18.916 7f8a35540630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 05:01:18.916 7f8a35540630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:18.969 7f8a3f5cce88 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 03/09/2026 05:01:18.970 7f8a35540630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:18.970 7f8a35540630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 03/09/2026 05:01:18.970 7f8a35540630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:18.974 7f8a3f5cce88 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 03/09/2026 05:01:18.974 7f8a35540e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:18.975 7f8a35540e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 05:01:18.975 7f8a35540e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:18.976 7f8a35576780 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 03/09/2026 05:01:18.977 7f8a3557e6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:18.977 7f8a3557e6d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 03/09/2026 05:01:18.977 7f8a3557e6d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:18.981 7f8a35576780 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 03/09/2026 05:01:18.982 7f8a354ed8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:18.982 7f8a354ed8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 05:01:18.982 7f8a354ed8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:20.131 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 05:01:20.133 7f8a35792630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 05:01:20.133 7f8a35792630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 05:01:20.133 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:01:20.133 7f8a35792630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/09/2026 05:01:20.134 7f8a35792630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:01:20.134 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 05:01:20.134 7f8a35792630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 05:01:20.134 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:20.134 7f8a35792630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 05:01:20.135 7f8a35792630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:20.135 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:20.135 7f8a35792630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 05:01:20.135 7f8a35792630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:24.134 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 05:01:24.135 7f8a35792630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 05:01:24.135 7f8a35792630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 05:01:24.136 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:01:24.136 7f8a35792630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/09/2026 05:01:24.136 7f8a35792630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:01:24.136 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 05:01:24.136 7f8a35792630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 05:01:24.136 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:24.136 7f8a35792630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 05:01:24.136 7f8a35792630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:24.136 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:24.137 7f8a35792630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 05:01:24.137 7f8a35792630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:28.136 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 05:01:28.137 7f8a35792630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 05:01:28.138 7f8a35792630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 05:01:28.138 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:01:28.138 7f8a35792630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/09/2026 05:01:28.138 7f8a35792630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:01:28.138 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 05:01:28.138 7f8a35792630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 05:01:28.139 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:28.139 7f8a35792630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 05:01:28.139 7f8a35792630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:28.139 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:28.139 7f8a35792630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 05:01:28.139 7f8a35792630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:32.139 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 05:01:32.140 7f8a35792630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 05:01:32.140 7f8a35792630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 05:01:32.140 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:01:32.141 7f8a35792630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/09/2026 05:01:32.141 7f8a35792630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:01:32.141 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 05:01:32.141 7f8a35792630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 05:01:32.141 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:32.142 7f8a35792630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 05:01:32.142 7f8a35792630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:32.142 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:32.142 7f8a35792630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 05:01:32.142 7f8a35792630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:36.140 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 05:01:36.142 7f8a35792630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 05:01:36.142 7f8a35792630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 05:01:36.142 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:01:36.142 7f8a35792630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/09/2026 05:01:36.142 7f8a35792630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:01:36.143 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 05:01:36.143 7f8a35792630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 05:01:36.143 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:36.143 7f8a35792630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 05:01:36.144 7f8a35792630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:36.144 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:36.144 7f8a35792630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 05:01:36.144 7f8a35792630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:40.142 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 05:01:40.144 7f8a35792630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/09/2026 05:01:40.144 7f8a35792630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 05:01:40.144 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:01:40.144 7f8a35792630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/09/2026 05:01:40.144 7f8a35792630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:01:40.144 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/09/2026 05:01:40.145 7f8a35792630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/09/2026 05:01:40.145 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:40.145 7f8a35792630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/09/2026 05:01:40.145 7f8a35792630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:40.145 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:40.145 7f8a35792630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 05:01:40.145 7f8a35792630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:44.144 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 05:01:44.145 7f8a35792630 [contrail-device-manager] [INFO]: Session Event: TCP Connected 03/09/2026 05:01:44.145 7f8a35792630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 05:01:44.145 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:01:44.146 7f8a35792630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/09/2026 05:01:44.146 7f8a35792630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:01:44.146 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/09/2026 05:01:44.146 7f8a35792630 [contrail-device-manager] [DEBUG]: Send sandesh control message. uve type count # 19 03/09/2026 05:01:44.146 7f8a35792630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/09/2026 05:01:44.146 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/09/2026 05:01:44.146 7f8a35792630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/09/2026 05:01:44.146 7f8a35483198 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/09/2026 05:01:44.147 7f8a35483198 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/09/2026 05:01:44.416 7f8a35576828 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-5456-3.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.33', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-5456-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-5456-3.'], 'id_perms': {'created': '2026-03-09T05:01:44.405542', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2026-03-09T05:01:44.405542', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13757548460445655454, 'uuid_mslong': 16467171801514004009}}, 'parent_type': 'global-system-config', 'parent_uuid': '7b132d75-bf38-43c3-9a01-39ffe3e2db2e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e4872581-b492-4e29-beec-a16f2515e19e'}, 'oper': 'CREATE', 'request-id': 'req-af5ef83b-7158-49f4-9151-22d206a8b920', 'type': 'analytics_node', 'uuid': 'e4872581-b492-4e29-beec-a16f2515e19e'} 03/09/2026 05:01:44.442 7f8a35576828 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-5456-2.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.50', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-5456-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-5456-2.'], 'id_perms': {'created': '2026-03-09T05:01:44.409548', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2026-03-09T05:01:44.409548', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10275201564177278485, 'uuid_mslong': 16288835349815967863}}, 'parent_type': 'global-system-config', 'parent_uuid': '7b132d75-bf38-43c3-9a01-39ffe3e2db2e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e20d9172-de9b-4077-8e98-d961dc532615'}, 'oper': 'CREATE', 'request-id': 'req-3d21b80d-a2b1-4ee2-a416-38c9868fcb9b', 'type': 'analytics_node', 'uuid': 'e20d9172-de9b-4077-8e98-d961dc532615'} 03/09/2026 05:01:44.506 7f8a35576828 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-5456-1.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.38', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-5456-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-5456-1.'], 'id_perms': {'created': '2026-03-09T05:01:44.488013', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2026-03-09T05:01:44.488013', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9654454725583696778, 'uuid_mslong': 3735289585611915326}}, 'parent_type': 'global-system-config', 'parent_uuid': '7b132d75-bf38-43c3-9a01-39ffe3e2db2e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '33d66a16-739d-403e-85fb-836be281f38a'}, 'oper': 'CREATE', 'request-id': 'req-9487bf00-685d-44aa-bf5e-3c439dcd645f', 'type': 'analytics_node', 'uuid': '33d66a16-739d-403e-85fb-836be281f38a'} 03/09/2026 05:01:58.527 7f8a35483048 [contrail-device-manager] [ERROR]: Session Event: TCP Connection Closed 03/09/2026 05:01:58.528 7f8a3c65a240 [contrail-device-manager] [INFO]: Processing event[EvTcpClose] in state[ClientInit] 03/09/2026 05:01:58.528 7f8a3c65a240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle] 03/09/2026 05:01:58.529 7f8a3c65a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:58.529 7f8a3c65a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvTcpClose >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[ClientInit to Idle on EvTcpClose] connection down >>, ] >> 03/09/2026 05:01:58.529 7f8a3c65a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:58.529 7f8a3c65a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:01:58.529 7f8a3c65a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 1 pid = 138 http_port = 8096 start_time = 1773032364063259 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.33:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/09/2026 05:01:58.529 7f8a3c65a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/09/2026 05:02:02.520 7f8a35576828 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-5456-3.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.33', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-5456-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-5456-3.'], 'id_perms': {'created': '2026-03-09T05:02:02.505374', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2026-03-09T05:02:02.505374', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10962440326982778318, 'uuid_mslong': 14781556069222925057}}, 'parent_type': 'global-system-config', 'parent_uuid': '7b132d75-bf38-43c3-9a01-39ffe3e2db2e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'cd22a2ed-cd8d-4301-9822-69655939bdce'}, 'oper': 'CREATE', 'request-id': 'req-fd81f744-e8b3-48f7-bda1-c736176e174f', 'type': 'analytics_alarm_node', 'uuid': 'cd22a2ed-cd8d-4301-9822-69655939bdce'} 03/09/2026 05:02:02.528 7f8a35538a20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/09/2026 05:02:02.529 7f8a35538a20 [contrail-device-manager] [INFO]: Session Event: TCP Connected 03/09/2026 05:02:02.529 7f8a35538a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/09/2026 05:02:02.530 7f8a35538a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:02:02.530 7f8a35538a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5456-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.33:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/09/2026 05:02:02.530 7f8a35538a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/09/2026 05:02:02.530 7f8a35538a20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/09/2026 05:02:02.530 7f8a35538a20 [contrail-device-manager] [DEBUG]: Send sandesh control message. uve type count # 19 03/09/2026 05:02:02.530 7f8a35538a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/09/2026 05:02:02.530 7f8a35538a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/09/2026 05:02:02.530 7f8a35538a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/09/2026 05:02:02.530 7f8a354834e0 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/09/2026 05:02:02.531 7f8a354834e0 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/09/2026 05:02:02.537 7f8a369cbcc0 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001016 03/09/2026 05:02:02.537 7f8a369cbcc0 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/09/2026 05:02:02.538 7f8a3557ae10 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 03/09/2026 05:02:02.538 7f8a3557ae10 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 0 03/09/2026 05:02:02.538 7f8a3557ae10 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/09/2026 05:02:02.538 7f8a3557ae10 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/09/2026 05:02:02.538 7f8a3557ae10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 03/09/2026 05:02:02.538 7f8a35538a20 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/09/2026 05:02:02.540 7f8a35538a20 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/09/2026 05:02:02.645 7f8a35576828 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-5456-2.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.50', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-5456-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-5456-2.'], 'id_perms': {'created': '2026-03-09T05:02:02.629680', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2026-03-09T05:02:02.629680', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12565955687870686107, 'uuid_mslong': 11445064301686309975}}, 'parent_type': 'global-system-config', 'parent_uuid': '7b132d75-bf38-43c3-9a01-39ffe3e2db2e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9ed50958-0584-4457-ae63-3e1eeed4e39b'}, 'oper': 'CREATE', 'request-id': 'req-c71d951c-b0e1-496a-a924-2ea2d0ef1523', 'type': 'analytics_alarm_node', 'uuid': '9ed50958-0584-4457-ae63-3e1eeed4e39b'} 03/09/2026 05:02:02.711 7f8a35576828 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-5456-1.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.38', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-5456-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-5456-1.'], 'id_perms': {'created': '2026-03-09T05:02:02.698718', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2026-03-09T05:02:02.698718', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13567006524647350229, 'uuid_mslong': 15807869586224202130}}, 'parent_type': 'global-system-config', 'parent_uuid': '7b132d75-bf38-43c3-9a01-39ffe3e2db2e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'db60d5a2-8e98-4192-bc47-b08d97031fd5'}, 'oper': 'CREATE', 'request-id': 'req-24772760-8775-421d-add3-5b85fbc1b2c3', 'type': 'analytics_alarm_node', 'uuid': 'db60d5a2-8e98-4192-bc47-b08d97031fd5'} 03/09/2026 05:02:09.209 7f8a369cbcc0 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001296 03/09/2026 05:02:09.209 7f8a369cbcc0 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/09/2026 05:02:09.210 7f8a3552d6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 03/09/2026 05:02:09.210 7f8a3552d6d8 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 2 03/09/2026 05:02:09.210 7f8a3552d6d8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/09/2026 05:02:09.210 7f8a3552d6d8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/09/2026 05:02:14.483 7f8a35576828 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-5456-2.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.50', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-5456-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-5456-2.'], 'id_perms': {'created': '2026-03-09T05:02:14.469665', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2026-03-09T05:02:14.469665', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11603133636299883571, 'uuid_mslong': 10244862746950256444}}, 'parent_type': 'global-system-config', 'parent_uuid': '7b132d75-bf38-43c3-9a01-39ffe3e2db2e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8e2d1063-849a-473c-a106-9c90f10a8433'}, 'oper': 'CREATE', 'request-id': 'req-41f5d066-f554-409e-ac8d-df3c0c954d3c', 'type': 'analytics_snmp_node', 'uuid': '8e2d1063-849a-473c-a106-9c90f10a8433'} 03/09/2026 05:02:14.587 7f8a35576828 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-5456-3.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.33', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-5456-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-5456-3.'], 'id_perms': {'created': '2026-03-09T05:02:14.562262', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2026-03-09T05:02:14.562262', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11090662885472866627, 'uuid_mslong': 6901627592069826751}}, 'parent_type': 'global-system-config', 'parent_uuid': '7b132d75-bf38-43c3-9a01-39ffe3e2db2e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5fc781ba-855b-48bf-99e9-f3222c381143'}, 'oper': 'CREATE', 'request-id': 'req-3bda8375-9d84-4ec9-9986-c6cafb63326e', 'type': 'analytics_snmp_node', 'uuid': '5fc781ba-855b-48bf-99e9-f3222c381143'} 03/09/2026 05:02:14.626 7f8a35576828 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-5456-1.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.38', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-5456-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-5456-1.'], 'id_perms': {'created': '2026-03-09T05:02:14.609772', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2026-03-09T05:02:14.609772', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11737112196527628331, 'uuid_mslong': 10809929783236315066}}, 'parent_type': 'global-system-config', 'parent_uuid': '7b132d75-bf38-43c3-9a01-39ffe3e2db2e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '960495dd-48b7-47ba-a2e2-995b5aef202b'}, 'oper': 'CREATE', 'request-id': 'req-e7e66ee8-466e-4ca7-a631-4e936a6e9086', 'type': 'analytics_snmp_node', 'uuid': '960495dd-48b7-47ba-a2e2-995b5aef202b'} 03/09/2026 05:03:58.738 7f8a35576828 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-e9b5fb4a-31a8-4f5f-996b-1c08222c5c8d', 'type': 'global_system_config', 'uuid': '7b132d75-bf38-43c3-9a01-39ffe3e2db2e'} 03/09/2026 05:03:58.883 7f8a35576828 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-5456-1'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-5456-1', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-5456-1'], 'id_perms': {'created': '2026-03-09T05:03:58.873700', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2026-03-09T05:03:58.873700', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11495058866950794709, 'uuid_mslong': 3784968652077288750}}, 'parent_type': 'global-system-config', 'parent_uuid': '7b132d75-bf38-43c3-9a01-39ffe3e2db2e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3486e8ef-790e-4d2e-9f86-a722d4ce6dd5', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.25'}, 'oper': 'CREATE', 'request-id': 'req-afe5ffea-91c5-43f7-ab19-fabb60891ffb', 'type': 'virtual_router', 'uuid': '3486e8ef-790e-4d2e-9f86-a722d4ce6dd5'} 03/09/2026 05:03:59.250 7f8a35576828 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-5456-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-5456-1', 'vhost0'], 'id_perms': {'created': '2026-03-09T05:03:59.225519', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2026-03-09T05:03:59.225519', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11978357906000438347, 'uuid_mslong': 16011107952254141682}}, 'parent_type': 'virtual-router', 'parent_uuid': '3486e8ef-790e-4d2e-9f86-a722d4ce6dd5', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'de32e1da-228a-44f2-a63b-ad0d2ba5e44b', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:de:32:e1:da:22']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': 'a9fa0c2c-4357-4fb2-8198-440d1a5b16c4'}]}, 'oper': 'CREATE', 'request-id': 'req-6d4a71c6-6f2c-47f8-896d-283660d4ceb0', 'type': 'virtual_machine_interface', 'uuid': 'de32e1da-228a-44f2-a63b-ad0d2ba5e44b'} 03/09/2026 05:03:59.300 7f8a35576828 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-5456-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-6d4a71c6-6f2c-47f8-896d-283660d4ceb0', 'type': 'virtual_machine_interface', 'uuid': 'de32e1da-228a-44f2-a63b-ad0d2ba5e44b'} 03/09/2026 05:03:59.434 7f8a35576828 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-5456-2'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-5456-2', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-5456-2'], 'id_perms': {'created': '2026-03-09T05:03:59.423670', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2026-03-09T05:03:59.423670', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11954644319212444790, 'uuid_mslong': 7587602070162719861}}, 'parent_type': 'global-system-config', 'parent_uuid': '7b132d75-bf38-43c3-9a01-39ffe3e2db2e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '694c93e1-c911-4475-a5e7-6dab7ecc9c76', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.193'}, 'oper': 'CREATE', 'request-id': 'req-4fce2cd6-eb8f-435b-974f-ad87c2b3b758', 'type': 'virtual_router', 'uuid': '694c93e1-c911-4475-a5e7-6dab7ecc9c76'} 03/09/2026 05:03:59.778 7f8a35576828 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-5456-2', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-5456-2', 'vhost0'], 'id_perms': {'created': '2026-03-09T05:03:59.758011', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2026-03-09T05:03:59.758011', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12244956734950367441, 'uuid_mslong': 4873324915325289434}}, 'parent_type': 'virtual-router', 'parent_uuid': '694c93e1-c911-4475-a5e7-6dab7ecc9c76', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '43a18730-c506-43da-a9ee-d3461cbe60d1', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:43:a1:87:30:c5']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': 'a9fa0c2c-4357-4fb2-8198-440d1a5b16c4'}]}, 'oper': 'CREATE', 'request-id': 'req-60a93248-494e-42df-8bf0-774c570a8bef', 'type': 'virtual_machine_interface', 'uuid': '43a18730-c506-43da-a9ee-d3461cbe60d1'} 03/09/2026 05:03:59.836 7f8a35576828 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-163ddb56-6615-4f86-8868-830ba73df617', 'type': 'access_control_list', 'uuid': '9019e2d9-0e51-45a2-b407-27eed6624b72'} 03/09/2026 05:03:59.851 7f8a35576828 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-5456-2', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-60a93248-494e-42df-8bf0-774c570a8bef', 'type': 'virtual_machine_interface', 'uuid': '43a18730-c506-43da-a9ee-d3461cbe60d1'}