11/20/2025 04:59:30.214 7fc46c1ae908 [contrail-device-manager] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 11/20/2025 04:59:30.214 7fc46c1ae908 [contrail-device-manager] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 11/20/2025 04:59:30.214 7fc46c1ae908 [contrail-device-manager] [INFO]: SANDESH: Flow Logging: [None] -> [False] 11/20/2025 04:59:30.214 7fc4638a8048 [contrail-device-manager] [INFO]: Processing event[EvStart] in state[none] 11/20/2025 04:59:30.215 7fc4638a8048 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 11/20/2025 04:59:30.215 7fc4638a8048 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 11/20/2025 04:59:30.215 7fc4638a8048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 11/20/2025 04:59:30.215 7fc4638a8048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:30.215 7fc4638a8048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 11/20/2025 04:59:30.215 7fc4638a8048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:30.215 7fc4638a8048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:30.215 7fc4638a8048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 start_time = 1763614770215318 collector_name = collector_ip = collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 11/20/2025 04:59:30.215 7fc4638a8048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:30.264 7fc46c1ae908 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.38:5673//', 'pyamqp://guest:guest@10.0.0.50:5673//', 'pyamqp://guest:guest@10.0.0.242:5673//'] 11/20/2025 04:59:30.273 7fc46c1ae908 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 11/20/2025 04:59:30.274 7fc46381e2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:30.274 7fc46381e2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 11/20/2025 04:59:30.274 7fc46381e2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:30.274 7fc46381e2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:30.274 7fc46381e2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 11/20/2025 04:59:30.274 7fc46381e2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:30.283 7fc46c1ae908 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 11/20/2025 04:59:30.283 7fc46381e2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:30.283 7fc46381e2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 11/20/2025 04:59:30.283 7fc46381e2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:30.295 7fc46c1ae908 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 11/20/2025 04:59:30.295 7fc463822390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:30.296 7fc463822390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 11/20/2025 04:59:30.296 7fc463822390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:30.309 7fc46c1ae908 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 11/20/2025 04:59:30.309 7fc4638224e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:30.309 7fc4638224e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 11/20/2025 04:59:30.309 7fc4638224e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:30.324 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Removed remaining AMQP queue from previous run 11/20/2025 04:59:30.325 7fc46c1ae908 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 11/20/2025 04:59:30.325 7fc46c1ae908 [contrail-device-manager] [WARNING]: initializing cassandra cluster 11/20/2025 04:59:30.325 7fc46c1ae908 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 11/20/2025 04:59:30.326 7fc472003630 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting consumer greenlet 11/20/2025 04:59:30.326 7fc472003630 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 11/20/2025 04:59:30.326 7fc463822e10 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting publisher greenlet 11/20/2025 04:59:30.326 7fc463822e10 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Publisher connection 11/20/2025 04:59:30.327 7fc463698048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:30.327 7fc463698048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 11/20/2025 04:59:30.327 7fc463698048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:30.328 7fc46c1ae908 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 11/20/2025 04:59:30.337 7fc463822e10 [contrail-device-manager] [INFO]: KombuAmqpClient: Publisher connection established 11/20/2025 04:59:30.338 7fc472003630 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 11/20/2025 04:59:30.338 7fc472003630 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Waiting for consumer 11/20/2025 04:59:30.379 7fc46c1ae908 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 11/20/2025 04:59:30.381 7fc463676198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:30.381 7fc463676198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 11/20/2025 04:59:30.381 7fc463676198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:30.391 7fc46c1ae908 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 11/20/2025 04:59:30.391 7fc46366b780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:30.391 7fc46366b780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 11/20/2025 04:59:30.391 7fc46366b780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:31.398 7fc46c1ae908 [contrail-device-manager] [WARNING]: Waiting for keyspace config_db_uuid to be created 11/20/2025 04:59:31.420 7fc46c1ae908 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 11/20/2025 04:59:31.471 7fc46c1ae908 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 11/20/2025 04:59:31.991 7fc46c1ae908 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/20/2025 04:59:32.980 7fc46c1ae908 [contrail-device-manager] [WARNING]: table 'obj_uuid_table', created 11/20/2025 04:59:32.985 7fc46c1ae908 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/20/2025 04:59:34.216 7fc46357f198 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 04:59:34.218 7fc46357f198 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 04:59:34.218 7fc46357f198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 04:59:34.219 7fc46357f198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 04:59:34.219 7fc46357f198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 11/20/2025 04:59:34.219 7fc46357f198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 04:59:34.219 7fc46357f198 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 04:59:34.219 7fc46357f198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 04:59:34.220 7fc46357f198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:34.220 7fc46357f198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 11/20/2025 04:59:34.220 7fc46357f198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:34.220 7fc46357f198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:34.220 7fc46357f198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.242:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 04:59:34.220 7fc46357f198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:35.302 7fc46c1ae908 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/20/2025 04:59:36.388 7fc46c1ae908 [contrail-device-manager] [WARNING]: table 'obj_uuid_table' fixed with properties {'gc_grace_seconds': 864000} 11/20/2025 04:59:36.393 7fc46c1ae908 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/20/2025 04:59:38.221 7fc4635856d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 04:59:38.225 7fc4635856d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 04:59:38.225 7fc4635856d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 04:59:38.225 7fc4635856d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 04:59:38.225 7fc4635856d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 11/20/2025 04:59:38.226 7fc4635856d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 04:59:38.226 7fc4635856d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 04:59:38.226 7fc4635856d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 04:59:38.226 7fc4635856d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:38.226 7fc4635856d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 11/20/2025 04:59:38.226 7fc4635856d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:38.226 7fc4635856d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:38.226 7fc4635856d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 04:59:38.226 7fc4635856d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:38.394 7fc46c1ae908 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/20/2025 04:59:39.335 7fc46c1ae908 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table', created 11/20/2025 04:59:39.340 7fc46c1ae908 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/20/2025 04:59:40.986 7fc46c1ae908 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/20/2025 04:59:42.119 7fc46c1ae908 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table' fixed with properties {'gc_grace_seconds': 864000} 11/20/2025 04:59:42.124 7fc46c1ae908 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/20/2025 04:59:42.225 7fc46357f8d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 04:59:42.226 7fc46357f8d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 04:59:42.227 7fc46357f8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 04:59:42.227 7fc46357f8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 04:59:42.227 7fc46357f8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 11/20/2025 04:59:42.227 7fc46357f8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 04:59:42.227 7fc46357f8d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 04:59:42.227 7fc46357f8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 04:59:42.227 7fc46357f8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:42.228 7fc46357f8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 11/20/2025 04:59:42.228 7fc46357f8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:42.228 7fc46357f8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:42.228 7fc46357f8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 04:59:42.228 7fc46357f8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:44.144 7fc46c1ae908 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/20/2025 04:59:44.148 7fc46c1ae908 [contrail-device-manager] [WARNING]: table 'obj_shared_table', created 11/20/2025 04:59:44.151 7fc46c1ae908 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/20/2025 04:59:46.042 7fc46c1ae908 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/20/2025 04:59:46.227 7fc463590d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 04:59:46.229 7fc463590d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 04:59:46.229 7fc463590d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 04:59:46.229 7fc463590d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 04:59:46.229 7fc463590d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 11/20/2025 04:59:46.229 7fc463590d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 04:59:46.230 7fc463590d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 04:59:46.230 7fc463590d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 04:59:46.230 7fc463590d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:46.230 7fc463590d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 11/20/2025 04:59:46.230 7fc463590d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:46.230 7fc463590d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:46.230 7fc463590d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.242:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 04:59:46.230 7fc463590d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:46.344 7fc46c1ae908 [contrail-device-manager] [WARNING]: table 'obj_shared_table' fixed with properties {'gc_grace_seconds': 864000} 11/20/2025 04:59:46.349 7fc46c1ae908 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/20/2025 04:59:46.350 7fc46357f978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:46.350 7fc46357f978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 04:59:46.350 7fc46357f978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:46.371 7fc46c1ae908 [contrail-device-manager] [ERROR]: Error in db walk read 'type' 11/20/2025 04:59:46.371 7fc462d188d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:46.372 7fc462d188d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Zookeeper:Zookeeper[] connection down >>, ] >> 11/20/2025 04:59:46.372 7fc462d188d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:46.381 7fc462d18780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:46.381 7fc462d18780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 04:59:46.381 7fc462d18780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:46.381 7fc46c1ae908 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_status_consumer.dummy 11/20/2025 04:59:46.381 7fc46c1ae908 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_request_consumer 11/20/2025 04:59:46.382 7fc472003630 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 11/20/2025 04:59:46.383 7fc46c1ae908 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4772-2. 11/20/2025 04:59:46.387 7fc472003630 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 11/20/2025 04:59:46.399 7fc472003630 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4772-2.'] 11/20/2025 04:59:46.410 7fc472003630 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 11/20/2025 04:59:46.414 7fc472003630 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 11/20/2025 04:59:46.424 7fc472003630 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4772-2.'] 11/20/2025 04:59:46.895 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Fetching all containers 11/20/2025 04:59:46.973 7fc46c1ae908 [contrail-device-manager] [INFO]: Restarting dnsmasq docker: config_dnsmasq_1 11/20/2025 04:59:47.416 7fc46c1ae908 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4772-2..config_queue 11/20/2025 04:59:47.416 7fc46c1ae908 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4772-2..tftp_queue 11/20/2025 04:59:47.433 7fc472003630 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 11/20/2025 04:59:47.438 7fc472003630 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 11/20/2025 04:59:47.452 7fc472003630 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4772-2.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4772-2..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4772-2..tftp_queue'] 11/20/2025 04:59:47.918 7fc46c1ae908 [contrail-device-manager] [WARNING]: Process 138 prepared to run in Full mode... 11/20/2025 04:59:47.918 7fc46c1ae908 [contrail-device-manager] [WARNING]: Elected master Device Manager node. Initializing... 11/20/2025 04:59:47.918 7fc46c1ae908 [contrail-device-manager] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8096 11/20/2025 04:59:47.921 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add [config_updater.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/config_updater] to home page 11/20/2025 04:59:47.921 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_ConfigApiUpdateReq] 11/20/2025 04:59:47.922 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add [greenlets.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/greenlets] to home page 11/20/2025 04:59:47.922 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_GreenletObjectReq] 11/20/2025 04:59:47.922 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add [cpuinfo.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/nodeinfo/cpuinfo] to home page 11/20/2025 04:59:47.923 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CpuLoadInfoReq] 11/20/2025 04:59:47.926 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add [dm_introspect.xml:/usr/lib/python3.6/site-packages/device_manager/sandesh/dm_introspect] to home page 11/20/2025 04:59:47.926 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_RoutingInstanceList] 11/20/2025 04:59:47.926 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualNetworkList] 11/20/2025 04:59:47.926 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualMachineInterfaceList] 11/20/2025 04:59:47.926 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalInterfaceList] 11/20/2025 04:59:47.926 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalInterfaceList] 11/20/2025 04:59:47.926 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalRouterList] 11/20/2025 04:59:47.927 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_BgpRouterList] 11/20/2025 04:59:47.927 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalRouterList] 11/20/2025 04:59:47.927 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_InstanceIpList] 11/20/2025 04:59:47.927 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FloatingIpList] 11/20/2025 04:59:47.927 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PortTupleList] 11/20/2025 04:59:47.927 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FeatureFlagList] 11/20/2025 04:59:47.928 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add [sandesh_alarm.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_alarm] to home page 11/20/2025 04:59:47.928 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmCacheRequest] 11/20/2025 04:59:47.928 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmTypesRequest] 11/20/2025 04:59:47.928 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmAckRequest] 11/20/2025 04:59:47.930 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add [sandesh_ctrl.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_ctrl] to home page 11/20/2025 04:59:47.930 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlClientToServer] 11/20/2025 04:59:47.930 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlServerToClient] 11/20/2025 04:59:47.931 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add [sandesh_trace.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_trace] to home page 11/20/2025 04:59:47.931 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceRequest] 11/20/2025 04:59:47.931 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferListRequest] 11/20/2025 04:59:47.931 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceEnableDisableReq] 11/20/2025 04:59:47.931 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufStatusReq] 11/20/2025 04:59:47.931 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferEnableDisableReq] 11/20/2025 04:59:47.932 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add [sandesh_uve.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_uve] to home page 11/20/2025 04:59:47.932 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshMessageStatsReq] 11/20/2025 04:59:47.932 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsSet] 11/20/2025 04:59:47.932 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsStatus] 11/20/2025 04:59:47.932 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsSet] 11/20/2025 04:59:47.932 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsStatus] 11/20/2025 04:59:47.932 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsSet] 11/20/2025 04:59:47.932 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsReset] 11/20/2025 04:59:47.932 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsStatus] 11/20/2025 04:59:47.932 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueSet] 11/20/2025 04:59:47.932 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueStatus] 11/20/2025 04:59:47.932 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CollectorInfoRequest] 11/20/2025 04:59:47.933 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVEDSConfReq] 11/20/2025 04:59:47.933 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVECacheReq] 11/20/2025 04:59:47.933 7fc46c1ae908 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVETypesReq] 11/20/2025 04:59:47.935 7fc46c1ae908 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.ztp_queue 11/20/2025 04:59:47.948 7fc462c51780 [contrail-device-manager] [ERROR]: Cannot write http_port 8096 to /tmp/contrail-device-manager.1.http_port 11/20/2025 04:59:47.948 7fc462c51780 [contrail-device-manager] [ERROR]: Starting Introspect on HTTP Port 8096 11/20/2025 04:59:47.996 7fc4624a66d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:47.997 7fc4624a66d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Initializing description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 11/20/2025 04:59:47.997 7fc4624a66d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:48.013 7fc462378f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:48.013 7fc462378f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 11/20/2025 04:59:48.014 7fc462378f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:48.500 7fc472003630 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 11/20/2025 04:59:48.508 7fc472003630 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 11/20/2025 04:59:48.584 7fc472003630 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4772-2.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4772-2..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4772-2..tftp_queue', 'device_manager_ztp.ztp_queue'] 11/20/2025 04:59:50.229 7fc462378828 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 04:59:50.231 7fc462378828 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 04:59:50.231 7fc462378828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 04:59:50.231 7fc462378828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 04:59:50.231 7fc462378828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 11/20/2025 04:59:50.231 7fc462378828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 04:59:50.231 7fc462378828 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 04:59:50.232 7fc462378828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 04:59:50.232 7fc462378828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:50.232 7fc462378828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 11/20/2025 04:59:50.232 7fc462378828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:50.232 7fc462378828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:50.232 7fc462378828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 04:59:50.232 7fc462378828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:51.147 7fc46b024cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:51.147 7fc46b024cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 04:59:51.147 7fc46b024cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:54.231 7fc462245588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 04:59:54.233 7fc462245588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 04:59:54.233 7fc462245588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 04:59:54.233 7fc462245588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 04:59:54.233 7fc462245588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/20/2025 04:59:54.233 7fc462245588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 04:59:54.233 7fc462245588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 04:59:54.234 7fc462245588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 04:59:54.234 7fc462245588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:54.234 7fc462245588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 04:59:54.234 7fc462245588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:54.234 7fc462245588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:54.234 7fc462245588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 04:59:54.234 7fc462245588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:58.233 7fc4636a4978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 04:59:58.235 7fc4636a4978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 04:59:58.235 7fc4636a4978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 04:59:58.235 7fc4636a4978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 04:59:58.235 7fc4636a4978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/20/2025 04:59:58.235 7fc4636a4978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 04:59:58.235 7fc4636a4978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 04:59:58.236 7fc4636a4978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 04:59:58.236 7fc4636a4978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:58.236 7fc4636a4978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 04:59:58.236 7fc4636a4978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:58.236 7fc4636a4978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 04:59:58.236 7fc4636a4978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.242:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 04:59:58.236 7fc4636a4978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:02.235 7fc46361f6d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 05:00:02.239 7fc46361f6d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 05:00:02.239 7fc46361f6d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 05:00:02.239 7fc46361f6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:00:02.239 7fc46361f6d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/20/2025 05:00:02.239 7fc46361f6d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:00:02.239 7fc46361f6d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 05:00:02.240 7fc46361f6d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 05:00:02.240 7fc46361f6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:02.240 7fc46361f6d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 05:00:02.240 7fc46361f6d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:02.240 7fc46361f6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:02.240 7fc46361f6d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 05:00:02.240 7fc46361f6d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:06.240 7fc4635a66d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 05:00:06.242 7fc4635a66d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 05:00:06.243 7fc4635a66d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 05:00:06.243 7fc4635a66d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:00:06.243 7fc4635a66d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/20/2025 05:00:06.243 7fc4635a66d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:00:06.243 7fc4635a66d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 05:00:06.243 7fc4635a66d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 05:00:06.243 7fc4635a66d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:06.244 7fc4635a66d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 05:00:06.244 7fc4635a66d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:06.244 7fc4635a66d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:06.244 7fc4635a66d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 05:00:06.244 7fc4635a66d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:10.243 7fc4623e2390 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 05:00:10.245 7fc4623e2390 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 05:00:10.245 7fc4623e2390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 05:00:10.245 7fc4623e2390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:00:10.245 7fc4623e2390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/20/2025 05:00:10.245 7fc4623e2390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:00:10.245 7fc4623e2390 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 05:00:10.246 7fc4623e2390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 05:00:10.246 7fc4623e2390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:10.246 7fc4623e2390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 05:00:10.246 7fc4623e2390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:10.246 7fc4623e2390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:10.246 7fc4623e2390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.242:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 05:00:10.246 7fc4623e2390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:14.245 7fc462d10978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 05:00:14.246 7fc462d10978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 05:00:14.247 7fc462d10978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 05:00:14.247 7fc462d10978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:00:14.247 7fc462d10978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/20/2025 05:00:14.247 7fc462d10978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:00:14.247 7fc462d10978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 05:00:14.247 7fc462d10978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 05:00:14.247 7fc462d10978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:14.247 7fc462d10978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 05:00:14.247 7fc462d10978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:14.248 7fc462d10978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:14.248 7fc462d10978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 05:00:14.248 7fc462d10978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:18.247 7fc46653f240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 05:00:18.248 7fc46653f240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 05:00:18.248 7fc46653f240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 05:00:18.248 7fc46653f240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:00:18.249 7fc46653f240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/20/2025 05:00:18.249 7fc46653f240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:00:18.249 7fc46653f240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 05:00:18.249 7fc46653f240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 05:00:18.249 7fc46653f240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:18.249 7fc46653f240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 05:00:18.250 7fc46653f240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:18.250 7fc46653f240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:18.250 7fc46653f240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 05:00:18.250 7fc46653f240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:22.249 7fc46934a048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 05:00:22.250 7fc46934a048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 05:00:22.251 7fc46934a048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 05:00:22.251 7fc46934a048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:00:22.251 7fc46934a048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/20/2025 05:00:22.251 7fc46934a048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:00:22.251 7fc46934a048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 05:00:22.251 7fc46934a048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 05:00:22.251 7fc46934a048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:22.251 7fc46934a048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 05:00:22.251 7fc46934a048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:22.251 7fc46934a048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:22.252 7fc46934a048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.242:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 05:00:22.252 7fc46934a048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:26.252 7fc463822ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 05:00:26.256 7fc463822ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 05:00:26.257 7fc463822ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 05:00:26.257 7fc463822ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:00:26.257 7fc463822ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/20/2025 05:00:26.257 7fc463822ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:00:26.257 7fc463822ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 05:00:26.258 7fc463822ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 05:00:26.258 7fc463822ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:26.258 7fc463822ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 05:00:26.258 7fc463822ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:26.258 7fc463822ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:26.258 7fc463822ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 05:00:26.258 7fc463822ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:30.257 7fc4623e2ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 05:00:30.258 7fc4623e2ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 05:00:30.259 7fc4623e2ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 05:00:30.259 7fc4623e2ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:00:30.259 7fc4623e2ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/20/2025 05:00:30.259 7fc4623e2ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:00:30.259 7fc4623e2ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 05:00:30.259 7fc4623e2ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 05:00:30.260 7fc4623e2ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:30.260 7fc4623e2ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 05:00:30.260 7fc4623e2ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:30.260 7fc4623e2ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:30.260 7fc4623e2ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 05:00:30.260 7fc4623e2ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:34.259 7fc4623e2198 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 05:00:34.261 7fc4623e2198 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 05:00:34.261 7fc4623e2198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 05:00:34.261 7fc4623e2198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:00:34.261 7fc4623e2198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/20/2025 05:00:34.261 7fc4623e2198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:00:34.261 7fc4623e2198 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 05:00:34.262 7fc4623e2198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 05:00:34.262 7fc4623e2198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:34.262 7fc4623e2198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 05:00:34.262 7fc4623e2198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:34.262 7fc4623e2198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:34.262 7fc4623e2198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.242:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 05:00:34.262 7fc4623e2198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:38.176 7fc46c1ae908 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 11/20/2025 05:00:38.177 7fc46c1ae908 [contrail-device-manager] [WARNING]: initializing cassandra cluster 11/20/2025 05:00:38.177 7fc46c1ae908 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 11/20/2025 05:00:38.177 7fc46358bb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:38.177 7fc46358bb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 11/20/2025 05:00:38.178 7fc46358bb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:38.178 7fc46c1ae908 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 11/20/2025 05:00:38.229 7fc46c1ae908 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 11/20/2025 05:00:38.231 7fc4621fe048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:38.231 7fc4621fe048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Initializing description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 11/20/2025 05:00:38.231 7fc4621fe048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:38.240 7fc46c1ae908 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 11/20/2025 05:00:38.240 7fc462407eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:38.240 7fc462407eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 11/20/2025 05:00:38.240 7fc462407eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:38.258 7fc46c1ae908 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/20/2025 05:00:38.261 7fc462205cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 05:00:38.262 7fc462205cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 05:00:38.263 7fc462205cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 05:00:38.263 7fc462205cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:00:38.263 7fc462205cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 11/20/2025 05:00:38.263 7fc462205cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:00:38.263 7fc462205cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 05:00:38.263 7fc462205cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 05:00:38.263 7fc462205cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:38.263 7fc462205cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 11/20/2025 05:00:38.264 7fc462205cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:38.264 7fc462205cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:38.264 7fc462205cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 05:00:38.264 7fc462205cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:39.332 7fc46c1ae908 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace', created 11/20/2025 05:00:39.337 7fc46c1ae908 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/20/2025 05:00:39.344 7fc46c1ae908 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/20/2025 05:00:40.003 7fc46c1ae908 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None} 11/20/2025 05:00:40.008 7fc46c1ae908 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/20/2025 05:00:40.008 7fc46c1ae908 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 11/20/2025 05:00:40.078 7fc46c1ae908 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 11/20/2025 05:00:40.086 7fc46c1ae908 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/20/2025 05:00:41.425 7fc46c1ae908 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table', created 11/20/2025 05:00:41.430 7fc46c1ae908 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/20/2025 05:00:41.436 7fc46c1ae908 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/20/2025 05:00:42.263 7fc4621e5eb8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 05:00:42.264 7fc4621e5eb8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 05:00:42.265 7fc4621e5eb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 05:00:42.265 7fc4621e5eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:00:42.265 7fc4621e5eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 11/20/2025 05:00:42.265 7fc4621e5eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:00:42.265 7fc4621e5eb8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 05:00:42.266 7fc4621e5eb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 05:00:42.266 7fc4621e5eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:42.266 7fc4621e5eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 11/20/2025 05:00:42.266 7fc4621e5eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:42.267 7fc4621e5eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:42.267 7fc4621e5eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 05:00:42.267 7fc4621e5eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:42.352 7fc46c1ae908 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table' fixed with properties {'gc_grace_seconds': 864000} 11/20/2025 05:00:42.357 7fc46c1ae908 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/20/2025 05:00:42.363 7fc46c1ae908 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/20/2025 05:00:43.098 7fc46c1ae908 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table', created 11/20/2025 05:00:43.102 7fc46c1ae908 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/20/2025 05:00:43.109 7fc46c1ae908 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/20/2025 05:00:43.998 7fc46c1ae908 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table' fixed with properties {'gc_grace_seconds': 864000} 11/20/2025 05:00:44.015 7fc46c1ae908 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/20/2025 05:00:44.034 7fc46c1ae908 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/20/2025 05:00:45.051 7fc46c1ae908 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table', created 11/20/2025 05:00:45.060 7fc46c1ae908 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/20/2025 05:00:45.074 7fc46c1ae908 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/20/2025 05:00:46.000 7fc46c1ae908 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table' fixed with properties {'gc_grace_seconds': 864000} 11/20/2025 05:00:46.004 7fc46c1ae908 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/20/2025 05:00:46.011 7fc46c1ae908 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/20/2025 05:00:46.265 7fc46217b588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 05:00:46.269 7fc46217b588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 05:00:46.269 7fc46217b588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 05:00:46.269 7fc46217b588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:00:46.269 7fc46217b588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 11/20/2025 05:00:46.269 7fc46217b588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:00:46.269 7fc46217b588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 05:00:46.270 7fc46217b588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 05:00:46.270 7fc46217b588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:46.270 7fc46217b588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 11/20/2025 05:00:46.270 7fc46217b588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:46.270 7fc46217b588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:46.270 7fc46217b588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.242:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 05:00:46.270 7fc46217b588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:46.983 7fc46c1ae908 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table', created 11/20/2025 05:00:46.988 7fc46c1ae908 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/20/2025 05:00:46.995 7fc46c1ae908 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 11/20/2025 05:00:48.097 7fc46c1ae908 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table' fixed with properties {'gc_grace_seconds': 864000} 11/20/2025 05:00:48.120 7fc46c1ae908 [contrail-device-manager] [WARNING]: Zookeeper lock released. 11/20/2025 05:00:48.121 7fc4622026d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:48.121 7fc4622026d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 05:00:48.121 7fc4622026d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:48.192 7fc46c1ae908 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.38:5673//', 'pyamqp://guest:guest@10.0.0.50:5673//', 'pyamqp://guest:guest@10.0.0.242:5673//'] 11/20/2025 05:00:48.193 7fc46c1ae908 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 11/20/2025 05:00:48.194 7fc4621860f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:48.194 7fc4621860f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Initializing description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 11/20/2025 05:00:48.194 7fc4621860f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:48.194 7fc4621860f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:48.194 7fc4621860f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 11/20/2025 05:00:48.194 7fc4621860f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:48.198 7fc46c1ae908 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 11/20/2025 05:00:48.199 7fc4621860f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:48.199 7fc4621860f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 05:00:48.199 7fc4621860f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:48.260 7fc46c1ae908 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 11/20/2025 05:00:48.261 7fc46216e4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:48.261 7fc46216e4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 11/20/2025 05:00:48.261 7fc46216e4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:48.265 7fc46c1ae908 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 11/20/2025 05:00:48.266 7fc46216eac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:48.267 7fc46216eac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 05:00:48.267 7fc46216eac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:48.268 7fc4621860f0 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 11/20/2025 05:00:48.269 7fc4621e58d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:48.270 7fc4621e58d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 11/20/2025 05:00:48.270 7fc4621e58d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:48.284 7fc4621860f0 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 11/20/2025 05:00:48.284 7fc462174630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:48.285 7fc462174630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 05:00:48.285 7fc462174630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:49.550 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-2cf18493-a34e-4720-8e4c-fea804c34386', 'type': 'global_vrouter_config', 'uuid': 'da41b0aa-0716-464c-a941-eb3ccb71ea2a'} 11/20/2025 05:00:49.616 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-433550af-2e43-494c-b2a2-fc284a19b8b0', 'type': 'global_system_config', 'uuid': '285411f0-c3bd-41c9-9a4f-91669ad4b3fb'} 11/20/2025 05:00:49.711 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-4772-2'], 'obj_dict': {'bgp_router_parameters': {'address': '10.20.0.192', 'address_families': {'family': ['route-target', 'inet-vpn', 'e-vpn', 'erm-vpn', 'inet6-vpn']}, 'admin_down': False, 'auth_data': None, 'autonomous_system': 64512, 'cluster_id': None, 'gateway_address': None, 'hold_time': 0, 'identifier': '10.20.0.192', 'ipv6_gateway_address': None, 'local_autonomous_system': None, 'port': 179, 'router_type': 'control-node', 'source_port': None, 'vendor': 'contrail'}, 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4772-2', 'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-4772-2'], 'id_perms': {'created': '2025-11-20T05:00:49.695607', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-20T05:00:49.695607', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12345813402428113088, 'uuid_mslong': 3966939357545844473}}, 'parent_type': 'routing-instance', 'parent_uuid': '86fe7033-1648-4163-bf0b-31c1cc64d326', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '370d6653-f409-4ef9-ab55-23e0eafc00c0'}, 'oper': 'CREATE', 'request-id': 'req-573f52d3-3c2c-41e6-b7dc-ae9ab45d9c82', 'type': 'bgp_router', 'uuid': '370d6653-f409-4ef9-ab55-23e0eafc00c0'} 11/20/2025 05:00:49.966 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-048311c0-1d13-4be1-a5f3-e8a044d96a9f', 'type': 'global_system_config', 'uuid': '285411f0-c3bd-41c9-9a4f-91669ad4b3fb'} 11/20/2025 05:00:50.270 7fc462250240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 05:00:50.271 7fc462250240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 05:00:50.271 7fc462250240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 05:00:50.271 7fc462250240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:00:50.271 7fc462250240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/20/2025 05:00:50.271 7fc462250240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:00:50.271 7fc462250240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 05:00:50.272 7fc462250240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 05:00:50.272 7fc462250240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:50.272 7fc462250240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 05:00:50.272 7fc462250240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:50.272 7fc462250240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:50.272 7fc462250240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 05:00:50.272 7fc462250240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:50.336 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-4772-3'], 'obj_dict': {'bgp_router_parameters': {'address': '10.20.0.18', 'address_families': {'family': ['route-target', 'inet-vpn', 'e-vpn', 'erm-vpn', 'inet6-vpn']}, 'admin_down': False, 'auth_data': None, 'autonomous_system': 64512, 'cluster_id': None, 'gateway_address': None, 'hold_time': 0, 'identifier': '10.20.0.18', 'ipv6_gateway_address': None, 'local_autonomous_system': None, 'port': 179, 'router_type': 'control-node', 'source_port': None, 'vendor': 'contrail'}, 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4772-3', 'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-4772-3'], 'id_perms': {'created': '2025-11-20T05:00:50.322407', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-20T05:00:50.322407', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10218987583627931262, 'uuid_mslong': 16597177406046816602}}, 'parent_type': 'routing-instance', 'parent_uuid': '86fe7033-1648-4163-bf0b-31c1cc64d326', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e65504ea-498f-495a-8dd1-231096452e7e'}, 'oper': 'CREATE', 'request-id': 'req-dfc126bf-87ab-458f-9d88-8763a0d1e431', 'type': 'bgp_router', 'uuid': 'e65504ea-498f-495a-8dd1-231096452e7e'} 11/20/2025 05:00:50.376 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-c5f83e05-f003-4731-a00d-e505ba4eb226', 'type': 'global_system_config', 'uuid': '285411f0-c3bd-41c9-9a4f-91669ad4b3fb'} 11/20/2025 05:00:50.427 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-4772-1'], 'obj_dict': {'bgp_router_parameters': {'address': '10.20.0.209', 'address_families': {'family': ['route-target', 'inet-vpn', 'e-vpn', 'erm-vpn', 'inet6-vpn']}, 'admin_down': False, 'auth_data': None, 'autonomous_system': 64512, 'cluster_id': None, 'gateway_address': None, 'hold_time': 0, 'identifier': '10.20.0.209', 'ipv6_gateway_address': None, 'local_autonomous_system': None, 'port': 179, 'router_type': 'control-node', 'source_port': None, 'vendor': 'contrail'}, 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4772-1', 'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-4772-1'], 'id_perms': {'created': '2025-11-20T05:00:50.415201', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-20T05:00:50.415201', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12814955735630914854, 'uuid_mslong': 1681111321235049288}}, 'parent_type': 'routing-instance', 'parent_uuid': '86fe7033-1648-4163-bf0b-31c1cc64d326', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '175481d6-fa1a-4b48-b1d7-de5852a2a526'}, 'oper': 'CREATE', 'request-id': 'req-4e8a0f21-5648-42b4-b5ee-5b19027014c8', 'type': 'bgp_router', 'uuid': '175481d6-fa1a-4b48-b1d7-de5852a2a526'} 11/20/2025 05:00:50.486 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-4772-3'], 'oper': 'UPDATE', 'request-id': 'req-50f7a247-e6f8-4c78-a58f-2b06e9931c6a', 'type': 'bgp_router', 'uuid': 'e65504ea-498f-495a-8dd1-231096452e7e'} 11/20/2025 05:00:50.534 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-4772-2'], 'oper': 'UPDATE-IMPLICIT', 'request-id': 'req-50f7a247-e6f8-4c78-a58f-2b06e9931c6a', 'type': 'bgp_router', 'uuid': '370d6653-f409-4ef9-ab55-23e0eafc00c0'} 11/20/2025 05:00:50.599 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-4772-1'], 'oper': 'UPDATE', 'request-id': 'req-dd934818-41b1-43c4-944d-8a6a3d6e9366', 'type': 'bgp_router', 'uuid': '175481d6-fa1a-4b48-b1d7-de5852a2a526'} 11/20/2025 05:00:50.612 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-4772-3'], 'oper': 'UPDATE-IMPLICIT', 'request-id': 'req-dd934818-41b1-43c4-944d-8a6a3d6e9366', 'type': 'bgp_router', 'uuid': 'e65504ea-498f-495a-8dd1-231096452e7e'} 11/20/2025 05:00:50.665 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-4772-1'], 'oper': 'UPDATE', 'request-id': 'req-3bd87111-4536-4262-a477-9024645104ac', 'type': 'bgp_router', 'uuid': '175481d6-fa1a-4b48-b1d7-de5852a2a526'} 11/20/2025 05:00:50.679 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-4772-2'], 'oper': 'UPDATE-IMPLICIT', 'request-id': 'req-3bd87111-4536-4262-a477-9024645104ac', 'type': 'bgp_router', 'uuid': '370d6653-f409-4ef9-ab55-23e0eafc00c0'} 11/20/2025 05:00:50.690 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-bb14245c-e831-4ef7-aea7-3faafa17274d', 'type': 'global_system_config', 'uuid': '285411f0-c3bd-41c9-9a4f-91669ad4b3fb'} 11/20/2025 05:00:50.790 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-300d3cbf-a3fe-4627-bfc8-815b184720a6', 'type': 'global_system_config', 'uuid': '285411f0-c3bd-41c9-9a4f-91669ad4b3fb'} 11/20/2025 05:00:50.930 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-f23515c6-05f8-407d-95a7-3f81580e122a', 'type': 'global_system_config', 'uuid': '285411f0-c3bd-41c9-9a4f-91669ad4b3fb'} 11/20/2025 05:00:54.272 7fc46231b198 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 05:00:54.273 7fc46231b198 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 05:00:54.273 7fc46231b198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 05:00:54.274 7fc46231b198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:00:54.274 7fc46231b198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/20/2025 05:00:54.274 7fc46231b198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:00:54.274 7fc46231b198 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 05:00:54.274 7fc46231b198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 05:00:54.274 7fc46231b198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:54.275 7fc46231b198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 05:00:54.275 7fc46231b198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:54.275 7fc46231b198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:54.275 7fc46231b198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 05:00:54.275 7fc46231b198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:58.275 7fc46231b198 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 05:00:58.278 7fc46231b198 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 05:00:58.278 7fc46231b198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 05:00:58.278 7fc46231b198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:00:58.278 7fc46231b198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/20/2025 05:00:58.278 7fc46231b198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:00:58.279 7fc46231b198 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 05:00:58.279 7fc46231b198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 05:00:58.279 7fc46231b198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:58.279 7fc46231b198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 05:00:58.280 7fc46231b198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:58.280 7fc46231b198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:00:58.280 7fc46231b198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.242:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 05:00:58.280 7fc46231b198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:02.279 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 05:01:02.280 7fc463590630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 05:01:02.280 7fc463590630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 05:01:02.280 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:01:02.280 7fc463590630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/20/2025 05:01:02.281 7fc463590630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:01:02.281 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 05:01:02.281 7fc463590630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 05:01:02.281 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:02.281 7fc463590630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 05:01:02.281 7fc463590630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:02.281 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:02.281 7fc463590630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 05:01:02.282 7fc463590630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:06.281 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 05:01:06.282 7fc463590630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 05:01:06.282 7fc463590630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 05:01:06.282 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:01:06.282 7fc463590630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/20/2025 05:01:06.282 7fc463590630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:01:06.282 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 05:01:06.283 7fc463590630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 05:01:06.283 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:06.283 7fc463590630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 05:01:06.283 7fc463590630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:06.283 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:06.283 7fc463590630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 05:01:06.283 7fc463590630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:10.284 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 05:01:10.285 7fc463590630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 05:01:10.286 7fc463590630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 05:01:10.286 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:01:10.286 7fc463590630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/20/2025 05:01:10.286 7fc463590630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:01:10.286 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 05:01:10.287 7fc463590630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 05:01:10.287 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:10.287 7fc463590630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 05:01:10.287 7fc463590630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:10.287 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:10.287 7fc463590630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.242:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 05:01:10.287 7fc463590630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:14.286 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 05:01:14.288 7fc463590630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 05:01:14.288 7fc463590630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 05:01:14.288 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:01:14.288 7fc463590630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/20/2025 05:01:14.288 7fc463590630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:01:14.288 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 05:01:14.289 7fc463590630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 05:01:14.289 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:14.289 7fc463590630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 05:01:14.289 7fc463590630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:14.289 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:14.289 7fc463590630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 05:01:14.289 7fc463590630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:18.289 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 05:01:18.290 7fc463590630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 05:01:18.290 7fc463590630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 05:01:18.290 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:01:18.291 7fc463590630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/20/2025 05:01:18.291 7fc463590630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:01:18.291 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 05:01:18.291 7fc463590630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 05:01:18.291 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:18.292 7fc463590630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 05:01:18.292 7fc463590630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:18.292 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:18.292 7fc463590630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 05:01:18.292 7fc463590630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:22.291 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 05:01:22.293 7fc463590630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 05:01:22.293 7fc463590630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 05:01:22.293 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:01:22.293 7fc463590630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/20/2025 05:01:22.293 7fc463590630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:01:22.293 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 05:01:22.294 7fc463590630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 05:01:22.294 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:22.294 7fc463590630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 05:01:22.294 7fc463590630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:22.294 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:22.294 7fc463590630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.242:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 05:01:22.294 7fc463590630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:26.294 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 05:01:26.296 7fc463590630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 05:01:26.296 7fc463590630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 05:01:26.296 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:01:26.296 7fc463590630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/20/2025 05:01:26.296 7fc463590630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:01:26.296 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 05:01:26.297 7fc463590630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 05:01:26.297 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:26.297 7fc463590630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 05:01:26.298 7fc463590630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:26.298 7fc463590630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:26.298 7fc463590630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 05:01:26.298 7fc463590630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:27.857 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4772-3.'], 'obj_dict': {'database_node_ip_address': '10.0.0.242', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4772-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4772-3.'], 'id_perms': {'created': '2025-11-20T05:01:27.845171', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-20T05:01:27.845171', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10061797945056244887, 'uuid_mslong': 1269402864047047546}}, 'parent_type': 'global-system-config', 'parent_uuid': '285411f0-c3bd-41c9-9a4f-91669ad4b3fb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '119dd32d-e463-437a-8ba2-afebdcd53497'}, 'oper': 'CREATE', 'request-id': 'req-dca969ec-10b9-4cfa-8444-c773290ac241', 'type': 'database_node', 'uuid': '119dd32d-e463-437a-8ba2-afebdcd53497'} 11/20/2025 05:01:28.575 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4772-2.'], 'obj_dict': {'database_node_ip_address': '10.0.0.50', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4772-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4772-2.'], 'id_perms': {'created': '2025-11-20T05:01:28.544202', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-20T05:01:28.544202', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12465580264419340290, 'uuid_mslong': 3210112497664018500}}, 'parent_type': 'global-system-config', 'parent_uuid': '285411f0-c3bd-41c9-9a4f-91669ad4b3fb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2c8c9c4f-084e-4844-acfe-a3347bd5b002'}, 'oper': 'CREATE', 'request-id': 'req-c2a59a45-d16c-4125-a9e5-7e085a58d91a', 'type': 'database_node', 'uuid': '2c8c9c4f-084e-4844-acfe-a3347bd5b002'} 11/20/2025 05:01:28.687 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4772-1.'], 'obj_dict': {'database_node_ip_address': '10.0.0.38', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4772-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4772-1.'], 'id_perms': {'created': '2025-11-20T05:01:28.660253', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-20T05:01:28.660253', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12262231717331795527, 'uuid_mslong': 7921499540115440349}}, 'parent_type': 'global-system-config', 'parent_uuid': '285411f0-c3bd-41c9-9a4f-91669ad4b3fb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6deed1dc-a100-42dd-aa2c-32c76116fe47'}, 'oper': 'CREATE', 'request-id': 'req-21876478-ff56-42b2-bb45-d4597cea6be7', 'type': 'database_node', 'uuid': '6deed1dc-a100-42dd-aa2c-32c76116fe47'} 11/20/2025 05:01:30.297 7fc4621f7828 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 05:01:30.298 7fc4621f7828 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 05:01:30.298 7fc4621f7828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 05:01:30.298 7fc4621f7828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:01:30.298 7fc4621f7828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/20/2025 05:01:30.298 7fc4621f7828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:01:30.298 7fc4621f7828 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 05:01:30.299 7fc4621f7828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 05:01:30.299 7fc4621f7828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:30.299 7fc4621f7828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 05:01:30.299 7fc4621f7828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:30.299 7fc4621f7828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:30.299 7fc4621f7828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 05:01:30.299 7fc4621f7828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:34.299 7fc4621f7828 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 05:01:34.300 7fc4621f7828 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 05:01:34.300 7fc4621f7828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 05:01:34.300 7fc4621f7828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:01:34.301 7fc4621f7828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/20/2025 05:01:34.301 7fc4621f7828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:01:34.301 7fc4621f7828 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 05:01:34.301 7fc4621f7828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 05:01:34.301 7fc4621f7828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:34.301 7fc4621f7828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 05:01:34.301 7fc4621f7828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:34.302 7fc4621f7828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:34.302 7fc4621f7828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.242:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 05:01:34.302 7fc4621f7828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:38.302 7fc4621fec18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 05:01:38.303 7fc4621fec18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 05:01:38.303 7fc4621fec18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 05:01:38.303 7fc4621fec18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:01:38.303 7fc4621fec18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/20/2025 05:01:38.303 7fc4621fec18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:01:38.303 7fc4621fec18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 05:01:38.304 7fc4621fec18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 05:01:38.304 7fc4621fec18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:38.304 7fc4621fec18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 05:01:38.304 7fc4621fec18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:38.304 7fc4621fec18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:38.304 7fc4621fec18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 05:01:38.304 7fc4621fec18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:42.304 7fc4621fec18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 05:01:42.305 7fc4621fec18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 05:01:42.305 7fc4621fec18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 05:01:42.305 7fc4621fec18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:01:42.306 7fc4621fec18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/20/2025 05:01:42.306 7fc4621fec18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:01:42.306 7fc4621fec18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 05:01:42.306 7fc4621fec18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 05:01:42.306 7fc4621fec18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:42.306 7fc4621fec18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 05:01:42.306 7fc4621fec18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:42.306 7fc4621fec18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:42.306 7fc4621fec18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 05:01:42.307 7fc4621fec18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:46.306 7fc4621fec18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 05:01:46.308 7fc4621fec18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 05:01:46.308 7fc4621fec18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 05:01:46.308 7fc4621fec18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:01:46.308 7fc4621fec18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/20/2025 05:01:46.308 7fc4621fec18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:01:46.308 7fc4621fec18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 05:01:46.309 7fc4621fec18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 05:01:46.309 7fc4621fec18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:46.309 7fc4621fec18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 05:01:46.309 7fc4621fec18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:46.309 7fc4621fec18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:46.309 7fc4621fec18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.242:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 05:01:46.309 7fc4621fec18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:50.310 7fc4621fec18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 05:01:50.312 7fc4621fec18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 05:01:50.312 7fc4621fec18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 05:01:50.312 7fc4621fec18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:01:50.312 7fc4621fec18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/20/2025 05:01:50.312 7fc4621fec18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:01:50.312 7fc4621fec18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 05:01:50.312 7fc4621fec18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 05:01:50.313 7fc4621fec18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:50.313 7fc4621fec18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 05:01:50.313 7fc4621fec18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:50.313 7fc4621fec18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:50.313 7fc4621fec18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 05:01:50.313 7fc4621fec18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:54.312 7fc4621fec18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 05:01:54.314 7fc4621fec18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 05:01:54.314 7fc4621fec18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 05:01:54.314 7fc4621fec18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:01:54.314 7fc4621fec18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/20/2025 05:01:54.314 7fc4621fec18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:01:54.314 7fc4621fec18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 05:01:54.315 7fc4621fec18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 05:01:54.315 7fc4621fec18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:54.315 7fc4621fec18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 05:01:54.315 7fc4621fec18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:54.315 7fc4621fec18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:54.315 7fc4621fec18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 05:01:54.316 7fc4621fec18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:58.314 7fc4621fec18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 05:01:58.315 7fc4621fec18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 11/20/2025 05:01:58.316 7fc4621fec18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 05:01:58.316 7fc4621fec18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:01:58.316 7fc4621fec18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/20/2025 05:01:58.316 7fc4621fec18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:01:58.316 7fc4621fec18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 11/20/2025 05:01:58.316 7fc4621fec18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 11/20/2025 05:01:58.317 7fc4621fec18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:58.317 7fc4621fec18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 11/20/2025 05:01:58.318 7fc4621fec18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:58.318 7fc4621fec18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:01:58.318 7fc4621fec18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1763614770215318 collector_name = collector_ip = 10.0.0.242:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.50:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 11/20/2025 05:01:58.318 7fc4621fec18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 11/20/2025 05:02:01.189 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4772-2.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.50', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4772-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4772-2.'], 'id_perms': {'created': '2025-11-20T05:02:01.168118', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-20T05:02:01.168118', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12815901233724050860, 'uuid_mslong': 12941866971197228881}}, 'parent_type': 'global-system-config', 'parent_uuid': '285411f0-c3bd-41c9-9a4f-91669ad4b3fb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b39abf70-fc92-4751-b1db-3a45409ccdac'}, 'oper': 'CREATE', 'request-id': 'req-61752455-1a6f-4df2-ae61-d22bd3ee9ed9', 'type': 'analytics_node', 'uuid': 'b39abf70-fc92-4751-b1db-3a45409ccdac'} 11/20/2025 05:02:01.207 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4772-3.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.242', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4772-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4772-3.'], 'id_perms': {'created': '2025-11-20T05:02:01.181837', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-20T05:02:01.181837', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10603078741555311506, 'uuid_mslong': 17239155528131299992}}, 'parent_type': 'global-system-config', 'parent_uuid': '285411f0-c3bd-41c9-9a4f-91669ad4b3fb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ef3dc89d-a9fa-4a98-9325-b3f01be67392'}, 'oper': 'CREATE', 'request-id': 'req-0a4e2729-485a-4777-ad03-f417312613dc', 'type': 'analytics_node', 'uuid': 'ef3dc89d-a9fa-4a98-9325-b3f01be67392'} 11/20/2025 05:02:01.292 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4772-1.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.38', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4772-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4772-1.'], 'id_perms': {'created': '2025-11-20T05:02:01.280438', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-20T05:02:01.280438', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10775621968196008030, 'uuid_mslong': 2671970133659631805}}, 'parent_type': 'global-system-config', 'parent_uuid': '285411f0-c3bd-41c9-9a4f-91669ad4b3fb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2514beae-0b3c-40bd-958a-b316a037f85e'}, 'oper': 'CREATE', 'request-id': 'req-02426e55-a2a9-413c-b69e-63b06a8a4a43', 'type': 'analytics_node', 'uuid': '2514beae-0b3c-40bd-958a-b316a037f85e'} 11/20/2025 05:02:02.317 7fc463586828 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 11/20/2025 05:02:02.318 7fc463586828 [contrail-device-manager] [INFO]: Session Event: TCP Connected 11/20/2025 05:02:02.319 7fc463586828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 11/20/2025 05:02:02.319 7fc463586828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:02:02.320 7fc463586828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4772-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.50,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 11/20/2025 05:02:02.320 7fc463586828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 11/20/2025 05:02:02.320 7fc463586828 [contrail-device-manager] [INFO]: Processing event[EvTcpConnected] in state[Connect] 11/20/2025 05:02:02.320 7fc463586828 [contrail-device-manager] [DEBUG]: Send sandesh control message. uve type count # 19 11/20/2025 05:02:02.321 7fc463586828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 11/20/2025 05:02:02.321 7fc463586828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 11/20/2025 05:02:02.321 7fc463586828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 11/20/2025 05:02:02.321 7fc46358bc18 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 11/20/2025 05:02:02.323 7fc46358bc18 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 11/20/2025 05:02:15.143 7fc46231b198 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001016 11/20/2025 05:02:15.143 7fc46231b198 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 11/20/2025 05:02:15.144 7fc4623692e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 11/20/2025 05:02:15.144 7fc4623692e8 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 0 11/20/2025 05:02:15.144 7fc4623692e8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/20/2025 05:02:15.144 7fc4623692e8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 11/20/2025 05:02:15.144 7fc4623692e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 11/20/2025 05:02:15.145 7fc4621f08d0 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 11/20/2025 05:02:15.146 7fc4621f08d0 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 11/20/2025 05:02:20.019 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4772-2.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.50', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4772-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4772-2.'], 'id_perms': {'created': '2025-11-20T05:02:20.005141', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-20T05:02:20.005141', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13007179210711285114, 'uuid_mslong': 16842250098930044422}}, 'parent_type': 'global-system-config', 'parent_uuid': '285411f0-c3bd-41c9-9a4f-91669ad4b3fb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e9bbb13b-1d03-4e06-b482-c893c04abd7a'}, 'oper': 'CREATE', 'request-id': 'req-7e2ad879-577c-413c-b1f3-30829344c754', 'type': 'analytics_alarm_node', 'uuid': 'e9bbb13b-1d03-4e06-b482-c893c04abd7a'} 11/20/2025 05:02:20.158 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4772-3.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.242', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4772-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4772-3.'], 'id_perms': {'created': '2025-11-20T05:02:20.136311', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-20T05:02:20.136311', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13243674546356461394, 'uuid_mslong': 16614435322255000193}}, 'parent_type': 'global-system-config', 'parent_uuid': '285411f0-c3bd-41c9-9a4f-91669ad4b3fb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e69254e6-06b6-4281-b7ca-fbd4f8759f52'}, 'oper': 'CREATE', 'request-id': 'req-1b803ce5-253d-4920-a2e3-79460094772c', 'type': 'analytics_alarm_node', 'uuid': 'e69254e6-06b6-4281-b7ca-fbd4f8759f52'} 11/20/2025 05:02:20.300 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4772-1.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.38', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4772-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4772-1.'], 'id_perms': {'created': '2025-11-20T05:02:20.278749', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-20T05:02:20.278749', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10540988680809992642, 'uuid_mslong': 5383734445300665376}}, 'parent_type': 'global-system-config', 'parent_uuid': '285411f0-c3bd-41c9-9a4f-91669ad4b3fb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4ab6ddf4-292e-4c20-9249-1d5b4d17d1c2'}, 'oper': 'CREATE', 'request-id': 'req-afbeb1d8-039d-454a-85a6-82f815f8071c', 'type': 'analytics_alarm_node', 'uuid': '4ab6ddf4-292e-4c20-9249-1d5b4d17d1c2'} 11/20/2025 05:02:26.041 7fc46231b198 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001296 11/20/2025 05:02:26.041 7fc46231b198 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 11/20/2025 05:02:26.042 7fc4692aceb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 11/20/2025 05:02:26.042 7fc4692aceb8 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 2 11/20/2025 05:02:26.042 7fc4692aceb8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 11/20/2025 05:02:26.042 7fc4692aceb8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 11/20/2025 05:02:33.030 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4772-3.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.242', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4772-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4772-3.'], 'id_perms': {'created': '2025-11-20T05:02:33.005642', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-20T05:02:33.005642', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10133130612224085542, 'uuid_mslong': 4826895885005245116}}, 'parent_type': 'global-system-config', 'parent_uuid': '285411f0-c3bd-41c9-9a4f-91669ad4b3fb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '42fc943b-c188-4abc-8ca0-1c9aac40ce26'}, 'oper': 'CREATE', 'request-id': 'req-e85a1494-6015-4078-9fc5-547b81629da0', 'type': 'analytics_snmp_node', 'uuid': '42fc943b-c188-4abc-8ca0-1c9aac40ce26'} 11/20/2025 05:02:33.060 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4772-2.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.50', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4772-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4772-2.'], 'id_perms': {'created': '2025-11-20T05:02:33.021471', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-20T05:02:33.021471', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11722956256733687712, 'uuid_mslong': 16303104441986861164}}, 'parent_type': 'global-system-config', 'parent_uuid': '285411f0-c3bd-41c9-9a4f-91669ad4b3fb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e240431c-c8b8-486c-a2b0-4e9ac80defa0'}, 'oper': 'CREATE', 'request-id': 'req-f7b1cde6-ab4f-4af9-b74d-776784e01c61', 'type': 'analytics_snmp_node', 'uuid': 'e240431c-c8b8-486c-a2b0-4e9ac80defa0'} 11/20/2025 05:02:33.122 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4772-1.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.38', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4772-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4772-1.'], 'id_perms': {'created': '2025-11-20T05:02:33.110466', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-20T05:02:33.110466', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10329422740794865213, 'uuid_mslong': 13730757547725900613}}, 'parent_type': 'global-system-config', 'parent_uuid': '285411f0-c3bd-41c9-9a4f-91669ad4b3fb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'be8d733d-b137-4b45-8f59-7b414feb763d'}, 'oper': 'CREATE', 'request-id': 'req-47f26f07-6c49-4159-b947-25646fd23b48', 'type': 'analytics_snmp_node', 'uuid': 'be8d733d-b137-4b45-8f59-7b414feb763d'} 11/20/2025 05:04:21.059 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-63b5c41d-a82f-4523-a9aa-fd2c84af2a4d', 'type': 'global_system_config', 'uuid': '285411f0-c3bd-41c9-9a4f-91669ad4b3fb'} 11/20/2025 05:04:21.201 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4772-2'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-4772-2', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4772-2'], 'id_perms': {'created': '2025-11-20T05:04:21.190894', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-20T05:04:21.190894', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9439457345923530583, 'uuid_mslong': 11451906653801433556}}, 'parent_type': 'global-system-config', 'parent_uuid': '285411f0-c3bd-41c9-9a4f-91669ad4b3fb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9eed586d-44c4-49d4-82ff-b07198393f57', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.201'}, 'oper': 'CREATE', 'request-id': 'req-6beeaa69-729d-4030-b504-cb307d59d14e', 'type': 'virtual_router', 'uuid': '9eed586d-44c4-49d4-82ff-b07198393f57'} 11/20/2025 05:04:21.589 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4772-2', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4772-2', 'vhost0'], 'id_perms': {'created': '2025-11-20T05:04:21.568428', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-20T05:04:21.568428', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12190763271936209246, 'uuid_mslong': 3139224779360455846}}, 'parent_type': 'virtual-router', 'parent_uuid': '9eed586d-44c4-49d4-82ff-b07198393f57', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2b90c44d-f3e2-4ca6-a92e-4a9b3ca2f15e', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:2b:90:c4:4d:f3']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '90a9f92d-2597-4fc1-9149-26ad35e6bf85'}]}, 'oper': 'CREATE', 'request-id': 'req-b281bd04-6154-43cf-b4c7-5e51079f5bb3', 'type': 'virtual_machine_interface', 'uuid': '2b90c44d-f3e2-4ca6-a92e-4a9b3ca2f15e'} 11/20/2025 05:04:21.647 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4772-2', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-b281bd04-6154-43cf-b4c7-5e51079f5bb3', 'type': 'virtual_machine_interface', 'uuid': '2b90c44d-f3e2-4ca6-a92e-4a9b3ca2f15e'} 11/20/2025 05:04:21.782 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4772-1'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-4772-1', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4772-1'], 'id_perms': {'created': '2025-11-20T05:04:21.773590', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-20T05:04:21.773590', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10308369946191535505, 'uuid_mslong': 7650040703700059947}}, 'parent_type': 'global-system-config', 'parent_uuid': '285411f0-c3bd-41c9-9a4f-91669ad4b3fb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6a2a677d-0552-472b-8f0e-afd9980f1d91', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.129'}, 'oper': 'CREATE', 'request-id': 'req-62fb05fb-9275-4445-8b46-965a0df42f54', 'type': 'virtual_router', 'uuid': '6a2a677d-0552-472b-8f0e-afd9980f1d91'} 11/20/2025 05:04:22.166 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4772-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4772-1', 'vhost0'], 'id_perms': {'created': '2025-11-20T05:04:22.129993', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-11-20T05:04:22.129993', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9307557471641136212, 'uuid_mslong': 7961913710319717894}}, 'parent_type': 'virtual-router', 'parent_uuid': '6a2a677d-0552-472b-8f0e-afd9980f1d91', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6e7e6655-e3eb-4e06-812b-1634f7b3ec54', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:6e:7e:66:55:e3']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '90a9f92d-2597-4fc1-9149-26ad35e6bf85'}]}, 'oper': 'CREATE', 'request-id': 'req-c3433820-127f-414d-9d43-a44bef149083', 'type': 'virtual_machine_interface', 'uuid': '6e7e6655-e3eb-4e06-812b-1634f7b3ec54'} 11/20/2025 05:04:22.213 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-f12b1ccb-1694-47bd-b9f7-1b744620900b', 'type': 'access_control_list', 'uuid': '73b2a5c6-b211-43b1-a005-7fd387c89258'} 11/20/2025 05:04:22.256 7fc46216eac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4772-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-c3433820-127f-414d-9d43-a44bef149083', 'type': 'virtual_machine_interface', 'uuid': '6e7e6655-e3eb-4e06-812b-1634f7b3ec54'}