11/06/2025 05:18:50.843 7f995212b408 [contrail-device-manager] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 11/06/2025 05:18:50.843 7f995212b408 [contrail-device-manager] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 11/06/2025 05:18:50.843 7f995212b408 [contrail-device-manager] [INFO]: SANDESH: Flow Logging: [None] -> [False] 11/06/2025 05:18:50.843 7f994981d048 [contrail-device-manager] [INFO]: Processing event[EvStart] in state[none] 11/06/2025 05:18:50.844 7f994981d048 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:18:50.844 7f994981d048 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 11/06/2025 05:18:50.844 7f994981d048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 11/06/2025 05:18:50.844 7f994981d048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:18:50.844 7f994981d048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 11/06/2025 05:18:50.844 7f994981d048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:18:50.845 7f994981d048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:18:50.845 7f994981d048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 start_time = 1762406330844420 collector_name = collector_ip = collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 11/06/2025 05:18:50.845 7f994981d048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:18:50.890 7f995212b408 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.50:5673//', 'pyamqp://guest:guest@10.0.0.249:5673//', 'pyamqp://guest:guest@10.0.0.241:5673//'] 11/06/2025 05:18:50.899 7f995212b408 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 11/06/2025 05:18:50.900 7f99497922e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:18:50.900 7f99497922e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 11/06/2025 05:18:50.900 7f99497922e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:18:50.900 7f99497922e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:18:50.900 7f99497922e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 11/06/2025 05:18:50.900 7f99497922e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:18:50.903 7f995212b408 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 11/06/2025 05:18:50.903 7f9949792828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:18:50.903 7f9949792828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 11/06/2025 05:18:50.904 7f9949792828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:18:50.938 7f995212b408 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 11/06/2025 05:18:50.939 7f99497844e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:18:50.939 7f99497844e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 11/06/2025 05:18:50.939 7f99497844e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:18:50.942 7f995212b408 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 11/06/2025 05:18:50.943 7f9949784828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:18:50.943 7f9949784828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 11/06/2025 05:18:50.943 7f9949784828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:18:50.977 7f995212b408 [contrail-device-manager] [DEBUG]: Removed remaining AMQP queue from previous run 11/06/2025 05:18:50.977 7f995212b408 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 11/06/2025 05:18:50.978 7f995212b408 [contrail-device-manager] [WARNING]: initializing cassandra cluster 11/06/2025 05:18:50.978 7f995212b408 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 11/06/2025 05:18:50.978 7f994f0a36d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting consumer greenlet 11/06/2025 05:18:50.978 7f994f0a36d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 11/06/2025 05:18:50.979 7f9949792ac8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting publisher greenlet 11/06/2025 05:18:50.979 7f9949792ac8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Publisher connection 11/06/2025 05:18:50.979 7f994960b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:18:50.979 7f994960b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 11/06/2025 05:18:50.979 7f994960b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:18:50.981 7f995212b408 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 11/06/2025 05:18:50.988 7f994f0a36d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 11/06/2025 05:18:50.988 7f994f0a36d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Waiting for consumer 11/06/2025 05:18:50.988 7f9949792ac8 [contrail-device-manager] [INFO]: KombuAmqpClient: Publisher connection established 11/06/2025 05:18:51.023 7f995212b408 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 11/06/2025 05:18:51.025 7f99495e86d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:18:51.025 7f99495e86d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 11/06/2025 05:18:51.025 7f99495e86d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:18:51.033 7f995212b408 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 11/06/2025 05:18:51.033 7f99494d2198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:18:51.033 7f99494d2198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 11/06/2025 05:18:51.033 7f99494d2198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:18:52.040 7f995212b408 [contrail-device-manager] [WARNING]: Waiting for keyspace config_db_uuid to be created 11/06/2025 05:18:52.049 7f995212b408 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 11/06/2025 05:18:52.070 7f995212b408 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 11/06/2025 05:18:54.432 7f995212b408 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/06/2025 05:18:54.756 7f995212b408 [contrail-device-manager] [WARNING]: table 'obj_uuid_table', created 11/06/2025 05:18:54.764 7f995212b408 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/06/2025 05:18:54.844 7f99495108d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:18:54.846 7f99495108d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:18:54.846 7f99495108d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:18:54.846 7f99495108d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:18:54.847 7f99495108d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 11/06/2025 05:18:54.847 7f99495108d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:18:54.847 7f99495108d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:18:54.848 7f99495108d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:18:54.848 7f99495108d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:18:54.848 7f99495108d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 11/06/2025 05:18:54.848 7f99495108d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:18:54.848 7f99495108d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:18:54.848 7f99495108d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:18:54.848 7f99495108d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:18:56.371 7f995212b408 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/06/2025 05:18:56.858 7f995212b408 [contrail-device-manager] [WARNING]: table 'obj_uuid_table' fixed with properties {'gc_grace_seconds': 864000} 11/06/2025 05:18:56.863 7f995212b408 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/06/2025 05:18:57.883 7f995212b408 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/06/2025 05:18:58.846 7f99495de390 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:18:58.847 7f99495de390 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:18:58.847 7f99495de390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:18:58.847 7f99495de390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:18:58.847 7f99495de390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 11/06/2025 05:18:58.847 7f99495de390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:18:58.847 7f99495de390 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:18:58.848 7f99495de390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:18:58.848 7f99495de390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:18:58.848 7f99495de390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 11/06/2025 05:18:58.848 7f99495de390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:18:58.848 7f99495de390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:18:58.848 7f99495de390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:18:58.848 7f99495de390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:18:58.918 7f995212b408 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table', created 11/06/2025 05:18:58.923 7f995212b408 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/06/2025 05:18:59.896 7f995212b408 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/06/2025 05:19:00.590 7f995212b408 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table' fixed with properties {'gc_grace_seconds': 864000} 11/06/2025 05:19:00.595 7f995212b408 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/06/2025 05:19:01.783 7f995212b408 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/06/2025 05:19:02.847 7f99494df240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:19:02.849 7f99494df240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:19:02.849 7f99494df240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:19:02.849 7f99494df240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:19:02.849 7f99494df240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 11/06/2025 05:19:02.849 7f99494df240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:19:02.849 7f99494df240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:19:02.850 7f99494df240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:19:02.850 7f99494df240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:02.850 7f99494df240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 11/06/2025 05:19:02.850 7f99494df240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:02.850 7f99494df240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:02.850 7f99494df240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:19:02.850 7f99494df240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:03.360 7f995212b408 [contrail-device-manager] [WARNING]: table 'obj_shared_table', created 11/06/2025 05:19:03.366 7f995212b408 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/06/2025 05:19:04.789 7f995212b408 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/06/2025 05:19:05.313 7f995212b408 [contrail-device-manager] [WARNING]: table 'obj_shared_table' fixed with properties {'gc_grace_seconds': 864000} 11/06/2025 05:19:05.318 7f995212b408 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/06/2025 05:19:05.319 7f9949605ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:05.319 7f9949605ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/06/2025 05:19:05.319 7f9949605ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:05.347 7f995212b408 [contrail-device-manager] [ERROR]: Error in db walk read 'type' 11/06/2025 05:19:05.348 7f9948c8cb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:05.348 7f9948c8cb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Zookeeper:Zookeeper[] connection down >>, ] >> 11/06/2025 05:19:05.348 7f9948c8cb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:05.366 7f9949509b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:05.366 7f9949509b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/06/2025 05:19:05.366 7f9949509b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:05.367 7f995212b408 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_status_consumer.dummy 11/06/2025 05:19:05.367 7f995212b408 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_request_consumer 11/06/2025 05:19:05.367 7f994f0a36d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 11/06/2025 05:19:05.367 7f995212b408 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4663-2. 11/06/2025 05:19:05.371 7f994f0a36d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 11/06/2025 05:19:05.456 7f994f0a36d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4663-2.'] 11/06/2025 05:19:05.474 7f994f0a36d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 11/06/2025 05:19:05.482 7f994f0a36d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 11/06/2025 05:19:05.635 7f994f0a36d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4663-2.'] 11/06/2025 05:19:05.879 7f995212b408 [contrail-device-manager] [DEBUG]: Fetching all containers 11/06/2025 05:19:05.926 7f995212b408 [contrail-device-manager] [INFO]: Restarting dnsmasq docker: config_dnsmasq_1 11/06/2025 05:19:06.143 7f995212b408 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4663-2..config_queue 11/06/2025 05:19:06.143 7f995212b408 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4663-2..tftp_queue 11/06/2025 05:19:06.644 7f995212b408 [contrail-device-manager] [WARNING]: Process 137 prepared to run in Full mode... 11/06/2025 05:19:06.644 7f995212b408 [contrail-device-manager] [WARNING]: Elected master Device Manager node. Initializing... 11/06/2025 05:19:06.644 7f995212b408 [contrail-device-manager] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8096 11/06/2025 05:19:06.647 7f995212b408 [contrail-device-manager] [DEBUG]: Add [config_updater.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/config_updater] to home page 11/06/2025 05:19:06.647 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_ConfigApiUpdateReq] 11/06/2025 05:19:06.648 7f995212b408 [contrail-device-manager] [DEBUG]: Add [greenlets.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/greenlets] to home page 11/06/2025 05:19:06.648 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_GreenletObjectReq] 11/06/2025 05:19:06.649 7f995212b408 [contrail-device-manager] [DEBUG]: Add [cpuinfo.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/nodeinfo/cpuinfo] to home page 11/06/2025 05:19:06.649 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CpuLoadInfoReq] 11/06/2025 05:19:06.654 7f995212b408 [contrail-device-manager] [DEBUG]: Add [dm_introspect.xml:/usr/lib/python3.6/site-packages/device_manager/sandesh/dm_introspect] to home page 11/06/2025 05:19:06.654 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_RoutingInstanceList] 11/06/2025 05:19:06.654 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualNetworkList] 11/06/2025 05:19:06.654 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualMachineInterfaceList] 11/06/2025 05:19:06.654 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalInterfaceList] 11/06/2025 05:19:06.654 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalInterfaceList] 11/06/2025 05:19:06.654 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalRouterList] 11/06/2025 05:19:06.654 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_BgpRouterList] 11/06/2025 05:19:06.654 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalRouterList] 11/06/2025 05:19:06.655 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_InstanceIpList] 11/06/2025 05:19:06.655 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FloatingIpList] 11/06/2025 05:19:06.655 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PortTupleList] 11/06/2025 05:19:06.655 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FeatureFlagList] 11/06/2025 05:19:06.656 7f995212b408 [contrail-device-manager] [DEBUG]: Add [sandesh_alarm.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_alarm] to home page 11/06/2025 05:19:06.656 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmCacheRequest] 11/06/2025 05:19:06.656 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmTypesRequest] 11/06/2025 05:19:06.656 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmAckRequest] 11/06/2025 05:19:06.657 7f995212b408 [contrail-device-manager] [DEBUG]: Add [sandesh_ctrl.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_ctrl] to home page 11/06/2025 05:19:06.657 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlClientToServer] 11/06/2025 05:19:06.657 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlServerToClient] 11/06/2025 05:19:06.657 7f995212b408 [contrail-device-manager] [DEBUG]: Add [sandesh_trace.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_trace] to home page 11/06/2025 05:19:06.657 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceRequest] 11/06/2025 05:19:06.657 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferListRequest] 11/06/2025 05:19:06.657 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceEnableDisableReq] 11/06/2025 05:19:06.658 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufStatusReq] 11/06/2025 05:19:06.658 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferEnableDisableReq] 11/06/2025 05:19:06.658 7f995212b408 [contrail-device-manager] [DEBUG]: Add [sandesh_uve.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_uve] to home page 11/06/2025 05:19:06.658 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshMessageStatsReq] 11/06/2025 05:19:06.658 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsSet] 11/06/2025 05:19:06.659 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsStatus] 11/06/2025 05:19:06.659 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsSet] 11/06/2025 05:19:06.659 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsStatus] 11/06/2025 05:19:06.659 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsSet] 11/06/2025 05:19:06.659 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsReset] 11/06/2025 05:19:06.659 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsStatus] 11/06/2025 05:19:06.659 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueSet] 11/06/2025 05:19:06.659 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueStatus] 11/06/2025 05:19:06.659 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CollectorInfoRequest] 11/06/2025 05:19:06.659 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVEDSConfReq] 11/06/2025 05:19:06.659 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVECacheReq] 11/06/2025 05:19:06.659 7f995212b408 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVETypesReq] 11/06/2025 05:19:06.662 7f995212b408 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.ztp_queue 11/06/2025 05:19:06.676 7f9948c07d68 [contrail-device-manager] [ERROR]: Cannot write http_port 8096 to /tmp/contrail-device-manager.1.http_port 11/06/2025 05:19:06.676 7f9948c07d68 [contrail-device-manager] [ERROR]: Starting Introspect on HTTP Port 8096 11/06/2025 05:19:06.720 7f99483a5438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:06.728 7f99483a5438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Initializing description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 11/06/2025 05:19:06.728 7f99483a5438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:06.738 7f99482eccc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:06.780 7f99482eccc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 11/06/2025 05:19:06.780 7f99482eccc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:06.780 7f994f0a36d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 11/06/2025 05:19:06.791 7f994f0a36d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 11/06/2025 05:19:06.850 7f99494d2eb8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:19:06.861 7f99494d2eb8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:19:06.862 7f99494d2eb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:19:06.862 7f99494d2eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:19:06.862 7f99494d2eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 11/06/2025 05:19:06.862 7f99494d2eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:19:06.862 7f99494d2eb8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:19:06.863 7f99494d2eb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:19:06.863 7f99494d2eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:06.863 7f99494d2eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 11/06/2025 05:19:06.863 7f99494d2eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:06.863 7f99494d2eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:06.863 7f99494d2eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:19:06.863 7f99494d2eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:07.173 7f994f0a36d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4663-2.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4663-2..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4663-2..tftp_queue', 'device_manager_ztp.ztp_queue'] 11/06/2025 05:19:07.240 7f994f0a36d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 11/06/2025 05:19:07.252 7f994f0a36d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 11/06/2025 05:19:07.347 7f994f0a36d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4663-2.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4663-2..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4663-2..tftp_queue', 'device_manager_ztp.ztp_queue'] 11/06/2025 05:19:10.862 7f994821dac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:19:10.864 7f994821dac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:19:10.864 7f994821dac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:19:10.864 7f994821dac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:19:10.864 7f994821dac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 11/06/2025 05:19:10.864 7f994821dac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:19:10.864 7f994821dac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:19:10.864 7f994821dac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:19:10.865 7f994821dac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:10.865 7f994821dac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 11/06/2025 05:19:10.865 7f994821dac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:10.865 7f994821dac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:10.865 7f994821dac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:19:10.865 7f994821dac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:14.864 7f99482d2438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:19:14.865 7f99482d2438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:19:14.865 7f99482d2438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:19:14.865 7f99482d2438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:19:14.866 7f99482d2438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 11/06/2025 05:19:14.866 7f99482d2438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:19:14.866 7f99482d2438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:19:14.866 7f99482d2438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:19:14.866 7f99482d2438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:14.866 7f99482d2438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 11/06/2025 05:19:14.866 7f99482d2438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:14.866 7f99482d2438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:14.866 7f99482d2438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:19:14.866 7f99482d2438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:15.900 7f99482d2e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:15.900 7f99482d2e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/06/2025 05:19:15.900 7f99482d2e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:18.866 7f99481cb8d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:19:18.867 7f99481cb8d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:19:18.868 7f99481cb8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:19:18.868 7f99481cb8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:19:18.868 7f99481cb8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/06/2025 05:19:18.868 7f99481cb8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:19:18.868 7f99481cb8d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:19:18.868 7f99481cb8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:19:18.868 7f99481cb8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:18.868 7f99481cb8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/06/2025 05:19:18.868 7f99481cb8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:18.869 7f99481cb8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:18.869 7f99481cb8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:19:18.869 7f99481cb8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:22.867 7f99481b5828 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:19:22.868 7f99481b5828 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:19:22.869 7f99481b5828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:19:22.869 7f99481b5828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:19:22.869 7f99481b5828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/06/2025 05:19:22.869 7f99481b5828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:19:22.869 7f99481b5828 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:19:22.870 7f99481b5828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:19:22.870 7f99481b5828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:22.870 7f99481b5828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/06/2025 05:19:22.870 7f99481b5828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:22.870 7f99481b5828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:22.870 7f99481b5828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:19:22.870 7f99481b5828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:26.869 7f99481b5828 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:19:26.871 7f99481b5828 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:19:26.871 7f99481b5828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:19:26.871 7f99481b5828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:19:26.872 7f99481b5828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/06/2025 05:19:26.872 7f99481b5828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:19:26.872 7f99481b5828 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:19:26.872 7f99481b5828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:19:26.872 7f99481b5828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:26.872 7f99481b5828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/06/2025 05:19:26.872 7f99481b5828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:26.872 7f99481b5828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:26.872 7f99481b5828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:19:26.873 7f99481b5828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:30.872 7f99481b5828 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:19:30.874 7f99481b5828 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:19:30.874 7f99481b5828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:19:30.874 7f99481b5828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:19:30.875 7f99481b5828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/06/2025 05:19:30.875 7f99481b5828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:19:30.875 7f99481b5828 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:19:30.875 7f99481b5828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:19:30.875 7f99481b5828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:30.876 7f99481b5828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/06/2025 05:19:30.876 7f99481b5828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:30.876 7f99481b5828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:30.876 7f99481b5828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:19:30.876 7f99481b5828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:34.875 7f99481b5828 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:19:34.877 7f99481b5828 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:19:34.877 7f99481b5828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:19:34.877 7f99481b5828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:19:34.877 7f99481b5828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/06/2025 05:19:34.877 7f99481b5828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:19:34.877 7f99481b5828 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:19:34.878 7f99481b5828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:19:34.878 7f99481b5828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:34.878 7f99481b5828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/06/2025 05:19:34.878 7f99481b5828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:34.878 7f99481b5828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:34.878 7f99481b5828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:19:34.878 7f99481b5828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:38.878 7f99481b5828 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:19:38.881 7f99481b5828 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:19:38.881 7f99481b5828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:19:38.881 7f99481b5828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:19:38.881 7f99481b5828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/06/2025 05:19:38.881 7f99481b5828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:19:38.881 7f99481b5828 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:19:38.882 7f99481b5828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:19:38.882 7f99481b5828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:38.882 7f99481b5828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/06/2025 05:19:38.882 7f99481b5828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:38.883 7f99481b5828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:38.883 7f99481b5828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:19:38.883 7f99481b5828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:42.882 7f994950a588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:19:42.883 7f994950a588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:19:42.883 7f994950a588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:19:42.883 7f994950a588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:19:42.884 7f994950a588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/06/2025 05:19:42.884 7f994950a588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:19:42.884 7f994950a588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:19:42.884 7f994950a588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:19:42.884 7f994950a588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:42.884 7f994950a588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/06/2025 05:19:42.884 7f994950a588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:42.884 7f994950a588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:42.884 7f994950a588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:19:42.884 7f994950a588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:46.884 7f994c4b1240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:19:46.885 7f994c4b1240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:19:46.885 7f994c4b1240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:19:46.885 7f994c4b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:19:46.885 7f994c4b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/06/2025 05:19:46.886 7f994c4b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:19:46.886 7f994c4b1240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:19:46.886 7f994c4b1240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:19:46.886 7f994c4b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:46.886 7f994c4b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/06/2025 05:19:46.886 7f994c4b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:46.886 7f994c4b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:46.886 7f994c4b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:19:46.886 7f994c4b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:50.886 7f994c4b1240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:19:50.887 7f994c4b1240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:19:50.887 7f994c4b1240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:19:50.887 7f994c4b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:19:50.888 7f994c4b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/06/2025 05:19:50.888 7f994c4b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:19:50.888 7f994c4b1240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:19:50.888 7f994c4b1240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:19:50.888 7f994c4b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:50.888 7f994c4b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/06/2025 05:19:50.888 7f994c4b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:50.888 7f994c4b1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:50.888 7f994c4b1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:19:50.888 7f994c4b1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:54.889 7f99494f94e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:19:54.890 7f99494f94e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:19:54.890 7f99494f94e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:19:54.890 7f99494f94e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:19:54.891 7f99494f94e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/06/2025 05:19:54.891 7f99494f94e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:19:54.891 7f99494f94e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:19:54.891 7f99494f94e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:19:54.891 7f99494f94e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:54.891 7f99494f94e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/06/2025 05:19:54.892 7f99494f94e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:54.892 7f99494f94e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:54.892 7f99494f94e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:19:54.892 7f99494f94e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:58.891 7f99494f94e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:19:58.892 7f99494f94e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:19:58.892 7f99494f94e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:19:58.892 7f99494f94e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:19:58.892 7f99494f94e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/06/2025 05:19:58.892 7f99494f94e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:19:58.892 7f99494f94e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:19:58.893 7f99494f94e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:19:58.893 7f99494f94e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:58.893 7f99494f94e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/06/2025 05:19:58.893 7f99494f94e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:58.893 7f99494f94e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:19:58.893 7f99494f94e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:19:58.893 7f99494f94e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:02.892 7f99494f94e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:20:02.893 7f99494f94e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:20:02.894 7f99494f94e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:20:02.894 7f99494f94e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:20:02.894 7f99494f94e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/06/2025 05:20:02.894 7f99494f94e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:20:02.894 7f99494f94e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:20:02.894 7f99494f94e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:20:02.894 7f99494f94e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:02.894 7f99494f94e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/06/2025 05:20:02.894 7f99494f94e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:02.895 7f99494f94e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:02.895 7f99494f94e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:20:02.895 7f99494f94e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:06.894 7f9948268d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:20:06.895 7f9948268d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:20:06.895 7f9948268d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:20:06.895 7f9948268d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:20:06.896 7f9948268d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/06/2025 05:20:06.896 7f9948268d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:20:06.896 7f9948268d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:20:06.896 7f9948268d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:20:06.896 7f9948268d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:06.896 7f9948268d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/06/2025 05:20:06.896 7f9948268d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:06.896 7f9948268d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:06.896 7f9948268d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:20:06.896 7f9948268d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:10.896 7f994f269630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:20:10.897 7f994f269630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:20:10.897 7f994f269630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:20:10.897 7f994f269630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:20:10.897 7f994f269630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/06/2025 05:20:10.897 7f994f269630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:20:10.897 7f994f269630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:20:10.898 7f994f269630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:20:10.898 7f994f269630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:10.898 7f994f269630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/06/2025 05:20:10.898 7f994f269630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:10.898 7f994f269630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:10.898 7f994f269630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:20:10.898 7f994f269630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:14.897 7f99482f9a20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:20:14.899 7f99482f9a20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:20:14.900 7f99482f9a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:20:14.900 7f99482f9a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:20:14.900 7f99482f9a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/06/2025 05:20:14.900 7f99482f9a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:20:14.900 7f99482f9a20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:20:14.901 7f99482f9a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:20:14.901 7f99482f9a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:14.901 7f99482f9a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/06/2025 05:20:14.901 7f99482f9a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:14.901 7f99482f9a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:14.901 7f99482f9a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:20:14.901 7f99482f9a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:18.899 7f9948260198 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:20:18.901 7f9948260198 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:20:18.901 7f9948260198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:20:18.901 7f9948260198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:20:18.902 7f9948260198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/06/2025 05:20:18.902 7f9948260198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:20:18.902 7f9948260198 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:20:18.902 7f9948260198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:20:18.902 7f9948260198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:18.902 7f9948260198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/06/2025 05:20:18.902 7f9948260198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:18.902 7f9948260198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:18.903 7f9948260198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:20:18.903 7f9948260198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:22.902 7f9948263d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:20:22.903 7f9948263d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:20:22.903 7f9948263d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:20:22.903 7f9948263d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:20:22.903 7f9948263d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/06/2025 05:20:22.903 7f9948263d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:20:22.903 7f9948263d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:20:22.904 7f9948263d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:20:22.904 7f9948263d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:22.904 7f9948263d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/06/2025 05:20:22.904 7f9948263d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:22.904 7f9948263d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:22.904 7f9948263d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:20:22.904 7f9948263d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:26.904 7f994f269438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:20:26.905 7f994f269438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:20:26.905 7f994f269438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:20:26.905 7f994f269438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:20:26.906 7f994f269438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/06/2025 05:20:26.906 7f994f269438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:20:26.906 7f994f269438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:20:26.906 7f994f269438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:20:26.906 7f994f269438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:26.906 7f994f269438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/06/2025 05:20:26.906 7f994f269438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:26.906 7f994f269438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:26.907 7f994f269438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:20:26.907 7f994f269438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:30.906 7f9948c8c588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:20:30.907 7f9948c8c588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:20:30.907 7f9948c8c588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:20:30.907 7f9948c8c588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:20:30.908 7f9948c8c588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/06/2025 05:20:30.908 7f9948c8c588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:20:30.908 7f9948c8c588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:20:30.908 7f9948c8c588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:20:30.908 7f9948c8c588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:30.908 7f9948c8c588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/06/2025 05:20:30.908 7f9948c8c588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:30.908 7f9948c8c588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:30.908 7f9948c8c588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:20:30.908 7f9948c8c588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:34.348 7f995212b408 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 11/06/2025 05:20:34.348 7f995212b408 [contrail-device-manager] [WARNING]: initializing cassandra cluster 11/06/2025 05:20:34.349 7f995212b408 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 11/06/2025 05:20:34.349 7f99481b5ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:34.349 7f99481b5ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 11/06/2025 05:20:34.349 7f99481b5ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:34.350 7f995212b408 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 11/06/2025 05:20:34.374 7f995212b408 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 11/06/2025 05:20:34.376 7f99482914e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:34.376 7f99482914e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Initializing description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 11/06/2025 05:20:34.376 7f99482914e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:34.389 7f995212b408 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 11/06/2025 05:20:34.389 7f99482912e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:34.389 7f99482912e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 11/06/2025 05:20:34.390 7f99482912e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:34.401 7f995212b408 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/06/2025 05:20:34.865 7f995212b408 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace', created 11/06/2025 05:20:34.870 7f995212b408 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/06/2025 05:20:34.876 7f995212b408 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/06/2025 05:20:34.907 7f994832aa20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:20:34.909 7f994832aa20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:20:34.909 7f994832aa20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:20:34.909 7f994832aa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:20:34.909 7f994832aa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 11/06/2025 05:20:34.909 7f994832aa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:20:34.909 7f994832aa20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:20:34.909 7f994832aa20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:20:34.909 7f994832aa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:34.910 7f994832aa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 11/06/2025 05:20:34.910 7f994832aa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:34.910 7f994832aa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:34.910 7f994832aa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:20:34.910 7f994832aa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:35.750 7f995212b408 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None} 11/06/2025 05:20:35.807 7f995212b408 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/06/2025 05:20:35.807 7f995212b408 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 11/06/2025 05:20:35.877 7f995212b408 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 11/06/2025 05:20:35.888 7f995212b408 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/06/2025 05:20:36.668 7f995212b408 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table', created 11/06/2025 05:20:36.673 7f995212b408 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/06/2025 05:20:36.681 7f995212b408 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/06/2025 05:20:37.847 7f995212b408 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table' fixed with properties {'gc_grace_seconds': 864000} 11/06/2025 05:20:37.865 7f995212b408 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/06/2025 05:20:37.888 7f995212b408 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/06/2025 05:20:38.910 7f9948330048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:20:38.911 7f9948330048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:20:38.911 7f9948330048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:20:38.911 7f9948330048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:20:38.911 7f9948330048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 11/06/2025 05:20:38.911 7f9948330048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:20:38.911 7f9948330048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:20:38.912 7f9948330048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:20:38.912 7f9948330048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:38.912 7f9948330048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 11/06/2025 05:20:38.912 7f9948330048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:38.912 7f9948330048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:38.912 7f9948330048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:20:38.912 7f9948330048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:39.522 7f995212b408 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table', created 11/06/2025 05:20:39.534 7f995212b408 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/06/2025 05:20:39.559 7f995212b408 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/06/2025 05:20:40.454 7f995212b408 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table' fixed with properties {'gc_grace_seconds': 864000} 11/06/2025 05:20:40.460 7f995212b408 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/06/2025 05:20:40.469 7f995212b408 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/06/2025 05:20:41.829 7f995212b408 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table', created 11/06/2025 05:20:41.836 7f995212b408 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/06/2025 05:20:41.846 7f995212b408 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/06/2025 05:20:42.754 7f995212b408 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table' fixed with properties {'gc_grace_seconds': 864000} 11/06/2025 05:20:42.759 7f995212b408 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/06/2025 05:20:42.777 7f995212b408 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/06/2025 05:20:42.912 7f9948360eb8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:20:42.913 7f9948360eb8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:20:42.913 7f9948360eb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:20:42.913 7f9948360eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:20:42.914 7f9948360eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 11/06/2025 05:20:42.914 7f9948360eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:20:42.914 7f9948360eb8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:20:42.914 7f9948360eb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:20:42.914 7f9948360eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:42.914 7f9948360eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 11/06/2025 05:20:42.914 7f9948360eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:42.914 7f9948360eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:42.914 7f9948360eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:20:42.914 7f9948360eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:43.709 7f995212b408 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table', created 11/06/2025 05:20:43.714 7f995212b408 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/06/2025 05:20:43.723 7f995212b408 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/06/2025 05:20:44.824 7f995212b408 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table' fixed with properties {'gc_grace_seconds': 864000} 11/06/2025 05:20:44.835 7f995212b408 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/06/2025 05:20:44.836 7f994833d6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:44.836 7f994833d6d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/06/2025 05:20:44.836 7f994833d6d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:44.920 7f995212b408 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.50:5673//', 'pyamqp://guest:guest@10.0.0.249:5673//', 'pyamqp://guest:guest@10.0.0.241:5673//'] 11/06/2025 05:20:44.920 7f995212b408 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 11/06/2025 05:20:44.921 7f9948295e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:44.921 7f9948295e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Initializing description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 11/06/2025 05:20:44.921 7f9948295e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:44.921 7f9948295e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:44.921 7f9948295e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 11/06/2025 05:20:44.921 7f9948295e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:44.925 7f995212b408 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 11/06/2025 05:20:44.925 7f9948189cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:44.926 7f9948189cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/06/2025 05:20:44.926 7f9948189cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:44.991 7f995212b408 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 11/06/2025 05:20:44.992 7f9948187e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:44.993 7f9948187e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 11/06/2025 05:20:44.993 7f9948187e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:45.000 7f995212b408 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 11/06/2025 05:20:45.000 7f9948366978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:45.001 7f9948366978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/06/2025 05:20:45.001 7f9948366978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:45.004 7f9948189780 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 11/06/2025 05:20:45.005 7f99483466d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:45.005 7f99483466d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 11/06/2025 05:20:45.005 7f99483466d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:45.018 7f9948189780 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 11/06/2025 05:20:45.019 7f994818ad68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:45.019 7f994818ad68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/06/2025 05:20:45.019 7f994818ad68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:46.914 7f994960b780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:20:46.915 7f994960b780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:20:46.916 7f994960b780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:20:46.916 7f994960b780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:20:46.916 7f994960b780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/06/2025 05:20:46.916 7f994960b780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:20:46.916 7f994960b780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:20:46.916 7f994960b780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:20:46.916 7f994960b780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:46.917 7f994960b780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/06/2025 05:20:46.917 7f994960b780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:46.917 7f994960b780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:46.917 7f994960b780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:20:46.917 7f994960b780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:50.917 7f994960b780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:20:50.918 7f994960b780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:20:50.918 7f994960b780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:20:50.918 7f994960b780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:20:50.918 7f994960b780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/06/2025 05:20:50.918 7f994960b780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:20:50.918 7f994960b780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:20:50.919 7f994960b780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:20:50.919 7f994960b780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:50.919 7f994960b780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/06/2025 05:20:50.919 7f994960b780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:50.919 7f994960b780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:50.919 7f994960b780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:20:50.919 7f994960b780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:54.919 7f99495040f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:20:54.921 7f99495040f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:20:54.921 7f99495040f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:20:54.921 7f99495040f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:20:54.921 7f99495040f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/06/2025 05:20:54.921 7f99495040f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:20:54.921 7f99495040f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:20:54.922 7f99495040f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:20:54.922 7f99495040f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:54.922 7f99495040f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/06/2025 05:20:54.922 7f99495040f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:54.922 7f99495040f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:54.922 7f99495040f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:20:54.922 7f99495040f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:58.922 7f99495040f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:20:58.923 7f99495040f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:20:58.923 7f99495040f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:20:58.923 7f99495040f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:20:58.923 7f99495040f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/06/2025 05:20:58.924 7f99495040f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:20:58.924 7f99495040f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:20:58.924 7f99495040f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:20:58.924 7f99495040f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:58.924 7f99495040f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/06/2025 05:20:58.924 7f99495040f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:58.924 7f99495040f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:20:58.925 7f99495040f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:20:58.925 7f99495040f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:21:02.924 7f99495040f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:21:02.925 7f99495040f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:21:02.925 7f99495040f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:21:02.925 7f99495040f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:21:02.926 7f99495040f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/06/2025 05:21:02.926 7f99495040f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:21:02.926 7f99495040f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:21:02.926 7f99495040f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:21:02.926 7f99495040f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:21:02.926 7f99495040f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/06/2025 05:21:02.926 7f99495040f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:21:02.926 7f99495040f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:21:02.926 7f99495040f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:21:02.926 7f99495040f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:21:06.926 7f99495040f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:21:06.928 7f99495040f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/06/2025 05:21:06.928 7f99495040f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:21:06.928 7f99495040f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:21:06.928 7f99495040f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/06/2025 05:21:06.928 7f99495040f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:21:06.928 7f99495040f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/06/2025 05:21:06.929 7f99495040f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/06/2025 05:21:06.929 7f99495040f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:21:06.929 7f99495040f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/06/2025 05:21:06.929 7f99495040f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:21:06.929 7f99495040f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:21:06.929 7f99495040f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 137 http_port = 8096 start_time = 1762406330844420 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.241:8086, 10.0.0.249:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/06/2025 05:21:06.930 7f99495040f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/06/2025 05:21:08.855 7f9948187d68 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4663-3.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.241', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4663-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4663-3.'], 'id_perms': {'created': '2025-11-06T05:21:08.828510', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-06T05:21:08.828510', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13002449898676895221, 'uuid_mslong': 14512036241695654356}}, 'parent_type': 'global-system-config', 'parent_uuid': '0b13ab4a-06fa-4aed-b5de-a5a2cc861d43', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c9651c12-e1dd-41d4-b471-fb4afc733df5'}, 'oper': 'CREATE', 'request-id': 'req-7a8c24b6-41c2-4db4-9e00-395610077042', 'type': 'analytics_node', 'uuid': 'c9651c12-e1dd-41d4-b471-fb4afc733df5'} 11/06/2025 05:21:09.216 7f9948187d68 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4663-2.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.249', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4663-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4663-2.'], 'id_perms': {'created': '2025-11-06T05:21:09.209838', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-06T05:21:09.209838', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11599380851535041505, 'uuid_mslong': 17070005541376444759}}, 'parent_type': 'global-system-config', 'parent_uuid': '0b13ab4a-06fa-4aed-b5de-a5a2cc861d43', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ece4d799-5fb1-4957-a0f9-476da636d3e1'}, 'oper': 'CREATE', 'request-id': 'req-dd74d3cc-186f-4cd5-825b-6a7ef2ba6abf', 'type': 'analytics_node', 'uuid': 'ece4d799-5fb1-4957-a0f9-476da636d3e1'} 11/06/2025 05:21:09.310 7f9948187d68 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4663-1.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.50', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4663-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4663-1.'], 'id_perms': {'created': '2025-11-06T05:21:09.300094', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-06T05:21:09.300094', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11009150440510139212, 'uuid_mslong': 11128089353544025855}}, 'parent_type': 'global-system-config', 'parent_uuid': '0b13ab4a-06fa-4aed-b5de-a5a2cc861d43', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9a6eea4e-d2cc-46ff-98c8-5bff25712b4c'}, 'oper': 'CREATE', 'request-id': 'req-d51907c7-a9b5-447d-a2df-a61d1c0928b8', 'type': 'analytics_node', 'uuid': '9a6eea4e-d2cc-46ff-98c8-5bff25712b4c'} 11/06/2025 05:21:10.929 7f994809e438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/06/2025 05:21:10.930 7f994809e438 [contrail-device-manager] [INFO]: Session Event: TCP Connected 11/06/2025 05:21:10.930 7f994809e438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/06/2025 05:21:10.931 7f994809e438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:21:10.931 7f994809e438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4663-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.249:5673, 10.0.0.241:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.249:9041, 10.0.0.241:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.249:2181, 10.0.0.241:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.249,10.0.0.241:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/06/2025 05:21:10.931 7f994809e438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/06/2025 05:21:10.931 7f994809e438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnected] in state[Connect] 11/06/2025 05:21:10.931 7f994809e438 [contrail-device-manager] [DEBUG]: Send sandesh control message. uve type count # 19 11/06/2025 05:21:10.931 7f994809e438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 11/06/2025 05:21:10.931 7f994809e438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 11/06/2025 05:21:10.931 7f994809e438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 11/06/2025 05:21:10.932 7f994817eac8 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 11/06/2025 05:21:10.933 7f994817eac8 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 11/06/2025 05:21:20.392 7f994817e438 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001016 11/06/2025 05:21:20.392 7f994817e438 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 11/06/2025 05:21:20.393 7f99483660f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 11/06/2025 05:21:20.393 7f99483660f0 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 0 11/06/2025 05:21:20.393 7f99483660f0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:21:20.393 7f99483660f0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 11/06/2025 05:21:20.394 7f99483660f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 11/06/2025 05:21:20.394 7f994828b0f0 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 11/06/2025 05:21:20.395 7f994828b0f0 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 11/06/2025 05:21:26.223 7f9948187d68 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4663-3.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.241', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4663-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4663-3.'], 'id_perms': {'created': '2025-11-06T05:21:26.207607', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-06T05:21:26.207607', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12594848692118460799, 'uuid_mslong': 4589141325822838939}}, 'parent_type': 'global-system-config', 'parent_uuid': '0b13ab4a-06fa-4aed-b5de-a5a2cc861d43', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3fafe7b8-b5bc-489b-aec9-e427b583997f'}, 'oper': 'CREATE', 'request-id': 'req-427093b5-a591-4a8c-bcf8-5133eddb623b', 'type': 'analytics_alarm_node', 'uuid': '3fafe7b8-b5bc-489b-aec9-e427b583997f'} 11/06/2025 05:21:26.250 7f9948187d68 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4663-1.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.50', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4663-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4663-1.'], 'id_perms': {'created': '2025-11-06T05:21:26.239139', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-06T05:21:26.239139', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11100272298134192115, 'uuid_mslong': 8311448709987647712}}, 'parent_type': 'global-system-config', 'parent_uuid': '0b13ab4a-06fa-4aed-b5de-a5a2cc861d43', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '73583290-d7b1-40e0-9a0c-16d7e865bff3'}, 'oper': 'CREATE', 'request-id': 'req-a6593b53-d4ef-485c-8502-030adec79ce0', 'type': 'analytics_alarm_node', 'uuid': '73583290-d7b1-40e0-9a0c-16d7e865bff3'} 11/06/2025 05:21:26.300 7f9948187d68 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4663-2.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.249', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4663-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4663-2.'], 'id_perms': {'created': '2025-11-06T05:21:26.285283', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-06T05:21:26.285283', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13809738728814326546, 'uuid_mslong': 12560468695779461489}}, 'parent_type': 'global-system-config', 'parent_uuid': '0b13ab4a-06fa-4aed-b5de-a5a2cc861d43', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ae4fbfbb-0859-4971-bfa6-0c34ebeeb312'}, 'oper': 'CREATE', 'request-id': 'req-1752d15e-4a0e-4754-96a1-20be0b5be43b', 'type': 'analytics_alarm_node', 'uuid': 'ae4fbfbb-0859-4971-bfa6-0c34ebeeb312'} 11/06/2025 05:21:30.378 7f994817e438 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001296 11/06/2025 05:21:30.379 7f994817e438 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 11/06/2025 05:21:30.379 7f99481b5780 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 11/06/2025 05:21:30.379 7f99481b5780 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 2 11/06/2025 05:21:30.379 7f99481b5780 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:21:30.379 7f99481b5780 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 11/06/2025 05:21:35.684 7f9948187d68 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4663-2.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.249', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4663-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4663-2.'], 'id_perms': {'created': '2025-11-06T05:21:35.672611', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-06T05:21:35.672611', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11320257104455843620, 'uuid_mslong': 12743259476390726004}}, 'parent_type': 'global-system-config', 'parent_uuid': '0b13ab4a-06fa-4aed-b5de-a5a2cc861d43', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b0d926fa-22e6-4974-9d19-a1dbf52ebf24'}, 'oper': 'CREATE', 'request-id': 'req-80774e0e-1fb7-4e44-b403-cb4bfc7f2e52', 'type': 'analytics_snmp_node', 'uuid': 'b0d926fa-22e6-4974-9d19-a1dbf52ebf24'} 11/06/2025 05:21:37.079 7f9948187d68 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4663-1.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.50', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4663-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4663-1.'], 'id_perms': {'created': '2025-11-06T05:21:37.034607', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-06T05:21:37.034607', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13364547678199870401, 'uuid_mslong': 8372433433117409718}}, 'parent_type': 'global-system-config', 'parent_uuid': '0b13ab4a-06fa-4aed-b5de-a5a2cc861d43', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7430dbd9-2e91-41b6-b978-694e0edff3c1'}, 'oper': 'CREATE', 'request-id': 'req-5329ab08-5eab-4186-a670-d1abb761b815', 'type': 'analytics_snmp_node', 'uuid': '7430dbd9-2e91-41b6-b978-694e0edff3c1'} 11/06/2025 05:21:37.089 7f9948187d68 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4663-3.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.241', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4663-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4663-3.'], 'id_perms': {'created': '2025-11-06T05:21:37.054722', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-06T05:21:37.054722', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10514206021381143475, 'uuid_mslong': 13476126160949887804}}, 'parent_type': 'global-system-config', 'parent_uuid': '0b13ab4a-06fa-4aed-b5de-a5a2cc861d43', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'bb04d158-03c4-433c-91e9-f6ab77b23bb3'}, 'oper': 'CREATE', 'request-id': 'req-0f2cb9bc-36c0-46e9-98e9-b589a9a55c64', 'type': 'analytics_snmp_node', 'uuid': 'bb04d158-03c4-433c-91e9-f6ab77b23bb3'} 11/06/2025 05:23:25.055 7f9948187d68 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-a1217af3-cdb8-4d18-b03f-a30458c54c0c', 'type': 'global_system_config', 'uuid': '0b13ab4a-06fa-4aed-b5de-a5a2cc861d43'} 11/06/2025 05:23:25.125 7f9948187d68 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-b4864242-b417-45b7-8cfb-9cddcd01a571', 'type': 'global_system_config', 'uuid': '0b13ab4a-06fa-4aed-b5de-a5a2cc861d43'} 11/06/2025 05:23:25.233 7f9948187d68 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4663-1'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-4663-1', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4663-1'], 'id_perms': {'created': '2025-11-06T05:23:25.222053', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-06T05:23:25.222053', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10527385868469327446, 'uuid_mslong': 17379350577484087637}}, 'parent_type': 'global-system-config', 'parent_uuid': '0b13ab4a-06fa-4aed-b5de-a5a2cc861d43', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f12fdb45-3deb-4155-9218-c9abbf94d656', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.200'}, 'oper': 'CREATE', 'request-id': 'req-1d2a2fd8-7eeb-4a37-ba3b-8222bf29a4b8', 'type': 'virtual_router', 'uuid': 'f12fdb45-3deb-4155-9218-c9abbf94d656'} 11/06/2025 05:23:25.280 7f9948187d68 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4663-2'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-4663-2', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4663-2'], 'id_perms': {'created': '2025-11-06T05:23:25.271781', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-06T05:23:25.271781', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12863215966561758627, 'uuid_mslong': 9400365923386674395}}, 'parent_type': 'global-system-config', 'parent_uuid': '0b13ab4a-06fa-4aed-b5de-a5a2cc861d43', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8274cf00-8626-4cdb-b283-52c4f40beda3', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.252'}, 'oper': 'CREATE', 'request-id': 'req-ed3c1cf5-face-4871-8072-f0cc0a5287fd', 'type': 'virtual_router', 'uuid': '8274cf00-8626-4cdb-b283-52c4f40beda3'} 11/06/2025 05:23:25.608 7f9948187d68 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4663-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4663-1', 'vhost0'], 'id_perms': {'created': '2025-11-06T05:23:25.592487', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-06T05:23:25.592487', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11419664656362847866, 'uuid_mslong': 16693802053893574239}}, 'parent_type': 'virtual-router', 'parent_uuid': 'f12fdb45-3deb-4155-9218-c9abbf94d656', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e7ac4c85-3d03-4e5f-9e7a-cc8040973e7a', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:e7:ac:4c:85:3d']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': 'a32c40eb-a705-47bc-8463-90fd3f07da25'}]}, 'oper': 'CREATE', 'request-id': 'req-bd51e14a-6aff-4dad-a1e5-edbf1f00bd9e', 'type': 'virtual_machine_interface', 'uuid': 'e7ac4c85-3d03-4e5f-9e7a-cc8040973e7a'} 11/06/2025 05:23:25.667 7f9948187d68 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4663-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-bd51e14a-6aff-4dad-a1e5-edbf1f00bd9e', 'type': 'virtual_machine_interface', 'uuid': 'e7ac4c85-3d03-4e5f-9e7a-cc8040973e7a'} 11/06/2025 05:23:25.713 7f9948187d68 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4663-2', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4663-2', 'vhost0'], 'id_perms': {'created': '2025-11-06T05:23:25.692802', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-06T05:23:25.692802', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9790515506179612780, 'uuid_mslong': 17424753612558910450}}, 'parent_type': 'virtual-router', 'parent_uuid': '8274cf00-8626-4cdb-b283-52c4f40beda3', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f1d12917-1f47-43f2-87de-e5fb01ca206c', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:f1:d1:29:17:1f']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': 'a32c40eb-a705-47bc-8463-90fd3f07da25'}]}, 'oper': 'CREATE', 'request-id': 'req-dc76e2e0-1a83-44fd-98bf-c2d52512fc4c', 'type': 'virtual_machine_interface', 'uuid': 'f1d12917-1f47-43f2-87de-e5fb01ca206c'} 11/06/2025 05:23:25.764 7f9948187d68 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4663-2', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-dc76e2e0-1a83-44fd-98bf-c2d52512fc4c', 'type': 'virtual_machine_interface', 'uuid': 'f1d12917-1f47-43f2-87de-e5fb01ca206c'} 11/06/2025 05:23:26.151 7f9948187d68 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-00646ff6-20de-4fac-b8e7-35bf12bd5444', 'type': 'access_control_list', 'uuid': '0d869801-7e03-4de3-8e54-462dabcbbfb6'} 11/06/2025 05:23:59.594 7f9948336d68 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:24:35.376 7f994960b780 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:24:57.318 7f994a3bbac8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:25:20.021 7f99483746d8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:25:42.283 7f9948366780 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:26:04.799 7f9948183c18 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:26:27.290 7f994838c2e8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:26:49.707 7f994833f438 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:27:11.548 7f994a42bd68 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:27:33.583 7f994818d630 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:27:56.314 7f994960b780 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:28:18.197 7f9948378438 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:28:40.240 7f99481812e8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:29:03.593 7f9948360828 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:29:25.696 7f994a3bb4e0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:29:47.992 7f99483606d8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:30:10.671 7f994838c2e8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:30:33.028 7f994838c2e8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:30:55.319 7f994f0c5198 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:31:17.935 7f9948360eb8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:31:40.610 7f99483660f0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:32:03.424 7f994832ab70 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:32:25.964 7f994bf9d828 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:32:48.438 7f99481812e8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:33:10.939 7f9948376240 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:33:33.393 7f994a3bb4e0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:33:55.769 7f99483606d8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:34:18.406 7f994839a4e0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:34:41.357 7f9948366780 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:35:03.963 7f9948295390 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:35:27.026 7f994f285e10 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:35:49.654 7f994a42b978 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:36:12.145 7f994816b978 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:36:34.863 7f99495148d0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:36:57.294 7f994836dac8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:37:19.916 7f994a3bbac8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:37:43.266 7f9948360390 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:38:06.018 7f9948183048 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:38:28.424 7f994832ae10 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:38:51.408 7f994816bac8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:39:13.695 7f99483660f0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:39:35.839 7f9948360e10 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:39:58.880 7f994a43a6d8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:40:21.165 7f994a42bac8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:40:43.998 7f994a3bb4e0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:41:06.488 7f994818d630 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:41:28.902 7f994bf9d828 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:41:51.675 7f9948330630 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:42:13.300 7f9948376048 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:42:35.872 7f994f161390 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:42:58.531 7f994f161390 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:43:20.956 7f9948360390 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:43:43.352 7f9949884c18 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:44:06.285 7f9948360eb8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:44:28.999 7f9948376240 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:44:51.750 7f99481366d8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:45:14.475 7f994a43a6d8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:45:37.070 7f994a42bac8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:45:59.881 7f994954de10 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:46:22.493 7f9948181780 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:46:45.140 7f99483746d8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:46:56.687 7f99482600f0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:47:08.358 7f994816bac8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/06/2025 05:48:16.345 7f9948366780 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map