02/06/2025 00:48:00.593 7f1233ec1c88 [contrail-device-manager] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0]
02/06/2025 00:48:00.593 7f1233ec1c88 [contrail-device-manager] [INFO]: SANDESH: Trace: PRINT: [None] -> [False]
02/06/2025 00:48:00.593 7f1233ec1c88 [contrail-device-manager] [INFO]: SANDESH: Flow Logging: [None] -> [False]
02/06/2025 00:48:00.593 7f122b5e6b70 [contrail-device-manager] [INFO]: Processing event[EvStart] in state[none]
02/06/2025 00:48:00.593 7f122b5e6b70 [contrail-device-manager] [DEBUG]: Add uve <cn-jenkins-deploy-platform-ansible-os-2696-3., 1> in the [ObjectConfigNode:NodeStatusUVE] map
02/06/2025 00:48:00.593 7f122b5e6b70 [contrail-device-manager] [DEBUG]: Add uve <cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0, 1> in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map
02/06/2025 00:48:00.594 7f122b5e6b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle]
02/06/2025 00:48:00.594 7f122b5e6b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:00.594 7f122b5e6b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>,  ]  description = Collector:Collector[none to Idle on EvStart] connection down  >>,  ]  >>  
02/06/2025 00:48:00.594 7f122b5e6b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:00.594 7f122b5e6b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:00.594 7f122b5e6b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  start_time = 1738802880593853  collector_name =   collector_ip =   collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 1  >>  
02/06/2025 00:48:00.594 7f122b5e6b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:00.637 7f1233ec1c88 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.23:5673//', 'pyamqp://guest:guest@10.0.0.41:5673//', 'pyamqp://guest:guest@10.0.0.38:5673//']
02/06/2025 00:48:00.645 7f1233ec1c88 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down
02/06/2025 00:48:00.645 7f122b594198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:00.645 7f122b594198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down  >>,  ]  >>  
02/06/2025 00:48:00.646 7f122b594198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:00.646 7f122b594198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:00.646 7f122b594198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Down  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down  >>,  ]  >>  
02/06/2025 00:48:00.646 7f122b594198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:00.649 7f1233ec1c88 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.23:5673// at 0x7f122b5b7cf8>
02/06/2025 00:48:00.649 7f122b452b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:00.649 7f122b452b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart] connection down  >>,  ]  >>  
02/06/2025 00:48:00.649 7f122b452b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:00.682 7f1233ec1c88 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down
02/06/2025 00:48:00.682 7f122b594438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:00.683 7f122b594438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Down  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down  >>,  ]  >>  
02/06/2025 00:48:00.683 7f122b594438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:00.686 7f1233ec1c88 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.23:5673// at 0x7f122b438e10>
02/06/2025 00:48:00.686 7f122b594198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:00.686 7f122b594198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart] connection down  >>,  ]  >>  
02/06/2025 00:48:00.686 7f122b594198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:00.702 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Removed remaining AMQP queue from previous run
02/06/2025 00:48:00.702 7f1233ec1c88 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql
02/06/2025 00:48:00.702 7f1233ec1c88 [contrail-device-manager] [WARNING]: initializing cassandra cluster
02/06/2025 00:48:00.702 7f1233ec1c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create
02/06/2025 00:48:00.703 7f1230e57780 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting consumer greenlet
02/06/2025 00:48:00.703 7f1230e57780 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection
02/06/2025 00:48:00.703 7f122b58ee10 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting publisher greenlet
02/06/2025 00:48:00.703 7f122b58ee10 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Publisher connection
02/06/2025 00:48:00.703 7f122b3b2438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:00.703 7f122b3b2438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down  >>,  ]  >>  
02/06/2025 00:48:00.703 7f122b3b2438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:00.704 7f1233ec1c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created
02/06/2025 00:48:00.707 7f122b58ee10 [contrail-device-manager] [INFO]: KombuAmqpClient: Publisher connection established <Connection: amqp://guest:**@10.0.0.23:5673// at 0x7f122b4aa320>
02/06/2025 00:48:00.707 7f1230e57780 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established <Connection: amqp://guest:**@10.0.0.23:5673// at 0x7f122b4aa320>
02/06/2025 00:48:00.708 7f1230e57780 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Waiting for consumer
02/06/2025 00:48:00.736 7f1233ec1c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected
02/06/2025 00:48:00.737 7f122b2fbcc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:00.738 7f122b2fbcc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[], Zookeeper:Zookeeper[] connection down  >>,  ]  >>  
02/06/2025 00:48:00.738 7f122b2fbcc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:00.744 7f1233ec1c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS
02/06/2025 00:48:00.744 7f122b2fbcc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:00.744 7f122b2fbcc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down  >>,  ]  >>  
02/06/2025 00:48:00.744 7f122b2fbcc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:00.753 7f1233ec1c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready
02/06/2025 00:48:00.784 7f1233ec1c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready
02/06/2025 00:48:01.537 7f1233ec1c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
02/06/2025 00:48:02.391 7f1233ec1c88 [contrail-device-manager] [WARNING]: table 'obj_uuid_table', created
02/06/2025 00:48:02.397 7f1233ec1c88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
02/06/2025 00:48:04.431 7f1233ec1c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
02/06/2025 00:48:04.594 7f122b2c5eb8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:48:04.595 7f122b2c5eb8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:48:04.595 7f122b2c5eb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:48:04.596 7f122b2c5eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:48:04.596 7f122b2c5eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
02/06/2025 00:48:04.596 7f122b2c5eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:48:04.596 7f122b2c5eb8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:48:04.596 7f122b2c5eb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:48:04.596 7f122b2c5eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:04.596 7f122b2c5eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
02/06/2025 00:48:04.596 7f122b2c5eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:04.596 7f122b2c5eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:04.596 7f122b2c5eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.41:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:48:04.596 7f122b2c5eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:05.514 7f1233ec1c88 [contrail-device-manager] [WARNING]: table 'obj_uuid_table' fixed with properties {'gc_grace_seconds': 864000}
02/06/2025 00:48:05.519 7f1233ec1c88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
02/06/2025 00:48:07.289 7f1233ec1c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
02/06/2025 00:48:08.416 7f1233ec1c88 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table', created
02/06/2025 00:48:08.422 7f1233ec1c88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
02/06/2025 00:48:08.596 7f122b29d630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:48:08.597 7f122b29d630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:48:08.597 7f122b29d630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:48:08.597 7f122b29d630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:48:08.597 7f122b29d630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
02/06/2025 00:48:08.597 7f122b29d630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:48:08.597 7f122b29d630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:48:08.598 7f122b29d630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:48:08.598 7f122b29d630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:08.598 7f122b29d630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
02/06/2025 00:48:08.598 7f122b29d630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:08.598 7f122b29d630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:08.598 7f122b29d630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.23:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:48:08.598 7f122b29d630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:10.396 7f1233ec1c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
02/06/2025 00:48:11.555 7f1233ec1c88 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table' fixed with properties {'gc_grace_seconds': 864000}
02/06/2025 00:48:11.560 7f1233ec1c88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
02/06/2025 00:48:12.598 7f122b291780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:48:12.599 7f122b291780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:48:12.599 7f122b291780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:48:12.599 7f122b291780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:48:12.599 7f122b291780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
02/06/2025 00:48:12.600 7f122b291780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:48:12.600 7f122b291780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:48:12.600 7f122b291780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:48:12.600 7f122b291780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:12.600 7f122b291780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
02/06/2025 00:48:12.600 7f122b291780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:12.600 7f122b291780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:12.600 7f122b291780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.38:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:48:12.600 7f122b291780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:13.391 7f1233ec1c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
02/06/2025 00:48:13.393 7f1233ec1c88 [contrail-device-manager] [WARNING]: table 'obj_shared_table', created
02/06/2025 00:48:13.400 7f1233ec1c88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
02/06/2025 00:48:15.503 7f1233ec1c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
02/06/2025 00:48:16.600 7f122b2b7a20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:48:16.601 7f122b2b7a20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:48:16.601 7f122b2b7a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:48:16.601 7f122b2b7a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:48:16.602 7f122b2b7a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
02/06/2025 00:48:16.602 7f122b2b7a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:48:16.602 7f122b2b7a20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:48:16.602 7f122b2b7a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:48:16.602 7f122b2b7a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:16.602 7f122b2b7a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
02/06/2025 00:48:16.602 7f122b2b7a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:16.602 7f122b2b7a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:16.602 7f122b2b7a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.41:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:48:16.602 7f122b2b7a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:17.184 7f1233ec1c88 [contrail-device-manager] [WARNING]: table 'obj_shared_table' fixed with properties {'gc_grace_seconds': 864000}
02/06/2025 00:48:17.191 7f1233ec1c88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
02/06/2025 00:48:17.191 7f122b2b8b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:17.191 7f122b2b8b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:48:17.191 7f122b2b8b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:17.232 7f1233ec1c88 [contrail-device-manager] [ERROR]: Error in db walk read 'type'
02/06/2025 00:48:17.233 7f122b2c5eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:17.233 7f122b2c5eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Zookeeper:Zookeeper[] connection down  >>,  ]  >>  
02/06/2025 00:48:17.233 7f122b2c5eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:17.245 7f122b2910f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:17.245 7f122b2910f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:48:17.246 7f122b2910f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:17.246 7f1233ec1c88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_status_consumer.dummy
02/06/2025 00:48:17.246 7f1233ec1c88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_request_consumer
02/06/2025 00:48:17.246 7f1230e57780 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection
02/06/2025 00:48:17.247 7f1233ec1c88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2696-3.
02/06/2025 00:48:17.250 7f1230e57780 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established <Connection: amqp://guest:**@10.0.0.23:5673// at 0x7f122b4aa320>
02/06/2025 00:48:17.436 7f1230e57780 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2696-3.']
02/06/2025 00:48:17.461 7f1230e57780 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection
02/06/2025 00:48:17.465 7f1230e57780 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established <Connection: amqp://guest:**@10.0.0.23:5673// at 0x7f122b4aa320>
02/06/2025 00:48:17.496 7f1230e57780 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2696-3.']
02/06/2025 00:48:17.757 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Fetching all containers
02/06/2025 00:48:17.794 7f1233ec1c88 [contrail-device-manager] [INFO]: Restarting dnsmasq docker: config_dnsmasq_1
02/06/2025 00:48:17.950 7f1233ec1c88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2696-3..config_queue
02/06/2025 00:48:17.951 7f1233ec1c88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2696-3..tftp_queue
02/06/2025 00:48:18.451 7f1233ec1c88 [contrail-device-manager] [WARNING]: Process 140 prepared to run in Full mode...
02/06/2025 00:48:18.451 7f1233ec1c88 [contrail-device-manager] [WARNING]: Elected master Device Manager node. Initializing... 
02/06/2025 00:48:18.451 7f1233ec1c88 [contrail-device-manager] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8096
02/06/2025 00:48:18.456 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add [config_updater.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/config_updater] to home page
02/06/2025 00:48:18.456 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_ConfigApiUpdateReq]
02/06/2025 00:48:18.457 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add [greenlets.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/greenlets] to home page
02/06/2025 00:48:18.457 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_GreenletObjectReq]
02/06/2025 00:48:18.459 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add [cpuinfo.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/nodeinfo/cpuinfo] to home page
02/06/2025 00:48:18.459 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CpuLoadInfoReq]
02/06/2025 00:48:18.465 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add [dm_introspect.xml:/usr/lib/python3.6/site-packages/device_manager/sandesh/dm_introspect] to home page
02/06/2025 00:48:18.465 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_RoutingInstanceList]
02/06/2025 00:48:18.465 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualNetworkList]
02/06/2025 00:48:18.465 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualMachineInterfaceList]
02/06/2025 00:48:18.465 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalInterfaceList]
02/06/2025 00:48:18.465 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalInterfaceList]
02/06/2025 00:48:18.465 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalRouterList]
02/06/2025 00:48:18.466 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_BgpRouterList]
02/06/2025 00:48:18.466 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalRouterList]
02/06/2025 00:48:18.466 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_InstanceIpList]
02/06/2025 00:48:18.466 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FloatingIpList]
02/06/2025 00:48:18.466 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PortTupleList]
02/06/2025 00:48:18.466 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FeatureFlagList]
02/06/2025 00:48:18.468 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add [sandesh_alarm.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_alarm] to home page
02/06/2025 00:48:18.468 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmCacheRequest]
02/06/2025 00:48:18.468 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmTypesRequest]
02/06/2025 00:48:18.468 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmAckRequest]
02/06/2025 00:48:18.469 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add [sandesh_ctrl.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_ctrl] to home page
02/06/2025 00:48:18.469 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlClientToServer]
02/06/2025 00:48:18.469 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlServerToClient]
02/06/2025 00:48:18.470 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add [sandesh_trace.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_trace] to home page
02/06/2025 00:48:18.470 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceRequest]
02/06/2025 00:48:18.470 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferListRequest]
02/06/2025 00:48:18.470 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceEnableDisableReq]
02/06/2025 00:48:18.470 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufStatusReq]
02/06/2025 00:48:18.470 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferEnableDisableReq]
02/06/2025 00:48:18.471 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add [sandesh_uve.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_uve] to home page
02/06/2025 00:48:18.471 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshMessageStatsReq]
02/06/2025 00:48:18.471 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsSet]
02/06/2025 00:48:18.471 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsStatus]
02/06/2025 00:48:18.471 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsSet]
02/06/2025 00:48:18.471 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsStatus]
02/06/2025 00:48:18.471 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsSet]
02/06/2025 00:48:18.471 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsReset]
02/06/2025 00:48:18.471 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsStatus]
02/06/2025 00:48:18.471 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueSet]
02/06/2025 00:48:18.471 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueStatus]
02/06/2025 00:48:18.471 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CollectorInfoRequest]
02/06/2025 00:48:18.471 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVEDSConfReq]
02/06/2025 00:48:18.472 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVECacheReq]
02/06/2025 00:48:18.472 7f1233ec1c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVETypesReq]
02/06/2025 00:48:18.474 7f1233ec1c88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.ztp_queue
02/06/2025 00:48:18.487 7f122aa2bcc0 [contrail-device-manager] [ERROR]: Cannot write http_port 8096 to /tmp/contrail-device-manager.1.http_port
02/06/2025 00:48:18.487 7f122aa2bcc0 [contrail-device-manager] [ERROR]: Starting Introspect on HTTP Port 8096
02/06/2025 00:48:18.528 7f122a1a4588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:18.528 7f122a1a4588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Initializing  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down  >>,  ]  >>  
02/06/2025 00:48:18.528 7f122a1a4588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:18.538 7f122a0ee8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:18.538 7f122a0ee8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Down  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down  >>,  ]  >>  
02/06/2025 00:48:18.538 7f122a0ee8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:18.542 7f1230e57780 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection
02/06/2025 00:48:18.546 7f1230e57780 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established <Connection: amqp://guest:**@10.0.0.23:5673// at 0x7f122b4aa320>
02/06/2025 00:48:18.642 7f1230e57780 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2696-3.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2696-3..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2696-3..tftp_queue', 'device_manager_ztp.ztp_queue']
02/06/2025 00:48:20.602 7f122a088240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:48:20.603 7f122a088240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:48:20.606 7f122a088240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:48:20.606 7f122a088240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:48:20.606 7f122a088240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Down  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down  >>,  ]  >>  
02/06/2025 00:48:20.606 7f122a088240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:48:20.606 7f122a088240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:48:20.607 7f122a088240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:48:20.607 7f122a088240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:20.607 7f122a088240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Down  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down  >>,  ]  >>  
02/06/2025 00:48:20.607 7f122a088240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:20.607 7f122a088240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:20.608 7f122a088240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.23:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:48:20.608 7f122a088240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:24.655 7f122a02fcc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:24.656 7f122a02fcc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:48:24.656 7f122a02fcc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:24.656 7f122a02fcc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:48:24.657 7f122a02fcc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:48:24.658 7f122a02fcc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:48:24.658 7f122a02fcc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:48:24.658 7f122a02fcc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:48:24.658 7f122a02fcc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:48:24.658 7f122a02fcc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:48:24.658 7f122a02fcc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:48:24.658 7f122a02fcc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:24.658 7f122a02fcc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:48:24.658 7f122a02fcc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:24.658 7f122a02fcc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:24.659 7f122a02fcc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.38:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:48:24.659 7f122a02fcc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:28.658 7f1229fa4a20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:48:28.659 7f1229fa4a20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:48:28.659 7f1229fa4a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:48:28.659 7f1229fa4a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:48:28.659 7f1229fa4a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:48:28.659 7f1229fa4a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:48:28.659 7f1229fa4a20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:48:28.660 7f1229fa4a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:48:28.660 7f1229fa4a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:28.660 7f1229fa4a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:48:28.660 7f1229fa4a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:28.660 7f1229fa4a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:28.660 7f1229fa4a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.41:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:48:28.660 7f1229fa4a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:32.660 7f122b288cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:48:32.661 7f122b288cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:48:32.661 7f122b288cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:48:32.661 7f122b288cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:48:32.661 7f122b288cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:48:32.661 7f122b288cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:48:32.662 7f122b288cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:48:32.662 7f122b288cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:48:32.662 7f122b288cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:32.662 7f122b288cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:48:32.662 7f122b288cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:32.662 7f122b288cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:32.662 7f122b288cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.23:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:48:32.662 7f122b288cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:36.661 7f1229fa4eb8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:48:36.662 7f1229fa4eb8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:48:36.663 7f1229fa4eb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:48:36.663 7f1229fa4eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:48:36.663 7f1229fa4eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:48:36.663 7f1229fa4eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:48:36.663 7f1229fa4eb8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:48:36.663 7f1229fa4eb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:48:36.663 7f1229fa4eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:36.663 7f1229fa4eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:48:36.663 7f1229fa4eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:36.663 7f1229fa4eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:36.664 7f1229fa4eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.38:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:48:36.664 7f1229fa4eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:40.663 7f1229fa42e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:48:40.664 7f1229fa42e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:48:40.664 7f1229fa42e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:48:40.664 7f1229fa42e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:48:40.664 7f1229fa42e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:48:40.664 7f1229fa42e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:48:40.664 7f1229fa42e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:48:40.665 7f1229fa42e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:48:40.665 7f1229fa42e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:40.665 7f1229fa42e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:48:40.665 7f1229fa42e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:40.665 7f1229fa42e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:40.665 7f1229fa42e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.41:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:48:40.665 7f1229fa42e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:44.665 7f1229f9f240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:48:44.666 7f1229f9f240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:48:44.666 7f1229f9f240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:48:44.666 7f1229f9f240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:48:44.666 7f1229f9f240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:48:44.666 7f1229f9f240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:48:44.666 7f1229f9f240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:48:44.666 7f1229f9f240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:48:44.666 7f1229f9f240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:44.666 7f1229f9f240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:48:44.667 7f1229f9f240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:44.667 7f1229f9f240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:44.667 7f1229f9f240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.23:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:48:44.667 7f1229f9f240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:48.666 7f1229f9fd68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:48:48.667 7f1229f9fd68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:48:48.667 7f1229f9fd68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:48:48.667 7f1229f9fd68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:48:48.667 7f1229f9fd68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:48:48.668 7f1229f9fd68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:48:48.668 7f1229f9fd68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:48:48.668 7f1229f9fd68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:48:48.668 7f1229f9fd68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:48.668 7f1229f9fd68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:48:48.668 7f1229f9fd68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:48.668 7f1229f9fd68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:48.668 7f1229f9fd68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.38:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:48:48.668 7f1229f9fd68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:52.668 7f122b2fb2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:48:52.669 7f122b2fb2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:48:52.670 7f122b2fb2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:48:52.670 7f122b2fb2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:48:52.670 7f122b2fb2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:48:52.670 7f122b2fb2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:48:52.670 7f122b2fb2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:48:52.670 7f122b2fb2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:48:52.670 7f122b2fb2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:52.670 7f122b2fb2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:48:52.670 7f122b2fb2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:52.670 7f122b2fb2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:52.671 7f122b2fb2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.41:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:48:52.671 7f122b2fb2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:56.670 7f122a984198 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:48:56.671 7f122a984198 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:48:56.671 7f122a984198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:48:56.671 7f122a984198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:48:56.671 7f122a984198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:48:56.672 7f122a984198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:48:56.672 7f122a984198 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:48:56.672 7f122a984198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:48:56.672 7f122a984198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:56.672 7f122a984198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:48:56.672 7f122a984198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:56.672 7f122a984198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:48:56.672 7f122a984198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.23:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:48:56.672 7f122a984198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:00.672 7f122b291c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:49:00.673 7f122b291c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:49:00.673 7f122b291c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:49:00.673 7f122b291c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:49:00.673 7f122b291c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:49:00.673 7f122b291c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:49:00.674 7f122b291c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:49:00.674 7f122b291c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:49:00.674 7f122b291c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:00.674 7f122b291c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:49:00.674 7f122b291c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:00.674 7f122b291c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:00.674 7f122b291c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.38:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:49:00.674 7f122b291c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:04.673 7f122b2a3ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:49:04.674 7f122b2a3ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:49:04.675 7f122b2a3ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:49:04.675 7f122b2a3ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:49:04.675 7f122b2a3ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:49:04.675 7f122b2a3ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:49:04.675 7f122b2a3ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:49:04.675 7f122b2a3ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:49:04.675 7f122b2a3ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:04.675 7f122b2a3ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:49:04.675 7f122b2a3ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:04.675 7f122b2a3ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:04.676 7f122b2a3ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.41:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:49:04.676 7f122b2a3ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:07.209 7f1233ec1c88 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql
02/06/2025 00:49:07.209 7f1233ec1c88 [contrail-device-manager] [WARNING]: initializing cassandra cluster
02/06/2025 00:49:07.209 7f1233ec1c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create
02/06/2025 00:49:07.209 7f122b4a4ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:07.209 7f122b4a4ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
02/06/2025 00:49:07.210 7f122b4a4ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:07.210 7f1233ec1c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created
02/06/2025 00:49:07.238 7f1233ec1c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected
02/06/2025 00:49:07.239 7f122a180438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:07.240 7f122a180438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Initializing  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[], Zookeeper:Zookeeper[] connection down  >>,  ]  >>  
02/06/2025 00:49:07.240 7f122a180438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:07.245 7f1233ec1c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS
02/06/2025 00:49:07.245 7f122a180240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:07.245 7f122a180240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
02/06/2025 00:49:07.245 7f122a180240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:07.255 7f1233ec1c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
02/06/2025 00:49:07.495 7f1233ec1c88 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace', created
02/06/2025 00:49:07.498 7f1233ec1c88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
02/06/2025 00:49:07.502 7f1233ec1c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
02/06/2025 00:49:08.675 7f122a15beb8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:49:08.676 7f122a15beb8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:49:08.676 7f122a15beb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:49:08.676 7f122a15beb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:49:08.676 7f122a15beb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
02/06/2025 00:49:08.676 7f122a15beb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:49:08.676 7f122a15beb8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:49:08.677 7f122a15beb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:49:08.677 7f122a15beb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:08.677 7f122a15beb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
02/06/2025 00:49:08.677 7f122a15beb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:08.677 7f122a15beb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:08.677 7f122a15beb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.23:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:49:08.677 7f122a15beb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:09.157 7f1233ec1c88 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None}
02/06/2025 00:49:09.161 7f1233ec1c88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
02/06/2025 00:49:09.161 7f1233ec1c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready
02/06/2025 00:49:09.212 7f1233ec1c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready
02/06/2025 00:49:09.217 7f1233ec1c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
02/06/2025 00:49:09.579 7f1233ec1c88 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table', created
02/06/2025 00:49:09.582 7f1233ec1c88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
02/06/2025 00:49:09.586 7f1233ec1c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
02/06/2025 00:49:10.460 7f1233ec1c88 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table' fixed with properties {'gc_grace_seconds': 864000}
02/06/2025 00:49:10.463 7f1233ec1c88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
02/06/2025 00:49:10.467 7f1233ec1c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
02/06/2025 00:49:11.571 7f1233ec1c88 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table', created
02/06/2025 00:49:11.575 7f1233ec1c88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
02/06/2025 00:49:11.579 7f1233ec1c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
02/06/2025 00:49:12.474 7f1233ec1c88 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table' fixed with properties {'gc_grace_seconds': 864000}
02/06/2025 00:49:12.478 7f1233ec1c88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
02/06/2025 00:49:12.485 7f1233ec1c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
02/06/2025 00:49:12.677 7f1229e87eb8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:49:12.678 7f1229e87eb8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:49:12.678 7f1229e87eb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:49:12.678 7f1229e87eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:49:12.678 7f1229e87eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
02/06/2025 00:49:12.678 7f1229e87eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:49:12.678 7f1229e87eb8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:49:12.678 7f1229e87eb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:49:12.678 7f1229e87eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:12.679 7f1229e87eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
02/06/2025 00:49:12.679 7f1229e87eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:12.679 7f1229e87eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:12.679 7f1229e87eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.38:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:49:12.679 7f1229e87eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:13.583 7f1233ec1c88 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table', created
02/06/2025 00:49:13.589 7f1233ec1c88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
02/06/2025 00:49:13.594 7f1233ec1c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
02/06/2025 00:49:14.461 7f1233ec1c88 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table' fixed with properties {'gc_grace_seconds': 864000}
02/06/2025 00:49:14.464 7f1233ec1c88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
02/06/2025 00:49:14.470 7f1233ec1c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
02/06/2025 00:49:15.464 7f1233ec1c88 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table', created
02/06/2025 00:49:15.468 7f1233ec1c88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
02/06/2025 00:49:15.472 7f1233ec1c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
02/06/2025 00:49:16.678 7f1229fdca20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:49:16.679 7f1229fdca20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:49:16.679 7f1229fdca20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:49:16.679 7f1229fdca20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:49:16.679 7f1229fdca20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
02/06/2025 00:49:16.680 7f1229fdca20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:49:16.680 7f1229fdca20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:49:16.680 7f1229fdca20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:49:16.680 7f1229fdca20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:16.680 7f1229fdca20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
02/06/2025 00:49:16.680 7f1229fdca20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:16.680 7f1229fdca20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:16.680 7f1229fdca20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.41:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:49:16.680 7f1229fdca20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:17.167 7f1233ec1c88 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table' fixed with properties {'gc_grace_seconds': 864000}
02/06/2025 00:49:17.170 7f1233ec1c88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
02/06/2025 00:49:17.171 7f1229fa7eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:17.171 7f1229fa7eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:49:17.171 7f1229fa7eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:17.212 7f1233ec1c88 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.23:5673//', 'pyamqp://guest:guest@10.0.0.41:5673//', 'pyamqp://guest:guest@10.0.0.38:5673//']
02/06/2025 00:49:17.213 7f1233ec1c88 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down
02/06/2025 00:49:17.213 7f1229ee0240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:17.214 7f1229ee0240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Initializing  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down  >>,  ]  >>  
02/06/2025 00:49:17.214 7f1229ee0240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:17.214 7f1229ee0240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:17.214 7f1229ee0240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Down  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down  >>,  ]  >>  
02/06/2025 00:49:17.214 7f1229ee0240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:17.217 7f1233ec1c88 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.23:5673// at 0x7f122b3b1be0>
02/06/2025 00:49:17.218 7f12310bf2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:17.218 7f12310bf2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:49:17.218 7f12310bf2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:17.249 7f1233ec1c88 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down
02/06/2025 00:49:17.249 7f1229efb390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:17.249 7f1229efb390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Down  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down  >>,  ]  >>  
02/06/2025 00:49:17.249 7f1229efb390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:17.253 7f1233ec1c88 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.23:5673// at 0x7f1229e4cf98>
02/06/2025 00:49:17.253 7f1229efbe10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:17.253 7f1229efbe10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:49:17.253 7f1229efbe10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:17.254 7f1229efbf60 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down
02/06/2025 00:49:17.255 7f1229f10828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:17.255 7f1229f10828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Down  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down  >>,  ]  >>  
02/06/2025 00:49:17.255 7f1229f10828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:17.264 7f1229efbf60 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.23:5673// at 0x7f1229e4cf98>
02/06/2025 00:49:17.264 7f1229e88c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:17.264 7f1229e88c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:49:17.264 7f1229e88c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:20.680 7f1229eafa20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:49:20.681 7f1229eafa20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:49:20.681 7f1229eafa20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:49:20.682 7f1229eafa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:49:20.682 7f1229eafa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:49:20.682 7f1229eafa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:49:20.682 7f1229eafa20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:49:20.682 7f1229eafa20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:49:20.682 7f1229eafa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:20.682 7f1229eafa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:49:20.682 7f1229eafa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:20.682 7f1229eafa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:20.682 7f1229eafa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.23:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:49:20.683 7f1229eafa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:24.683 7f1229eafa20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:49:24.684 7f1229eafa20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:49:24.684 7f1229eafa20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:49:24.684 7f1229eafa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:49:24.685 7f1229eafa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:49:24.685 7f1229eafa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:49:24.685 7f1229eafa20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:49:24.685 7f1229eafa20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:49:24.685 7f1229eafa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:24.685 7f1229eafa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:49:24.685 7f1229eafa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:24.685 7f1229eafa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:24.685 7f1229eafa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.38:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:49:24.685 7f1229eafa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:28.686 7f1229eafa20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:49:28.687 7f1229eafa20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:49:28.687 7f1229eafa20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:49:28.687 7f1229eafa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:49:28.688 7f1229eafa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:49:28.688 7f1229eafa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:49:28.688 7f1229eafa20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:49:28.688 7f1229eafa20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:49:28.688 7f1229eafa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:28.688 7f1229eafa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:49:28.688 7f1229eafa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:28.688 7f1229eafa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:28.688 7f1229eafa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.41:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:49:28.688 7f1229eafa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:32.688 7f122b279c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:49:32.689 7f122b279c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:49:32.689 7f122b279c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:49:32.689 7f122b279c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:49:32.689 7f122b279c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:49:32.690 7f122b279c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:49:32.690 7f122b279c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:49:32.690 7f122b279c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:49:32.690 7f122b279c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:32.690 7f122b279c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:49:32.690 7f122b279c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:32.690 7f122b279c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:32.690 7f122b279c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.23:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:49:32.690 7f122b279c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:36.690 7f122b279c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:49:36.691 7f122b279c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:49:36.691 7f122b279c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:49:36.692 7f122b279c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:49:36.692 7f122b279c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:49:36.692 7f122b279c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:49:36.692 7f122b279c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:49:36.692 7f122b279c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:49:36.692 7f122b279c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:36.692 7f122b279c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:49:36.692 7f122b279c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:36.692 7f122b279c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:36.692 7f122b279c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.38:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:49:36.692 7f122b279c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:40.693 7f122b279c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:49:40.694 7f122b279c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:49:40.695 7f122b279c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:49:40.695 7f122b279c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:49:40.695 7f122b279c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:49:40.695 7f122b279c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:49:40.695 7f122b279c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:49:40.695 7f122b279c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:49:40.695 7f122b279c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:40.695 7f122b279c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:49:40.695 7f122b279c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:40.695 7f122b279c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:40.696 7f122b279c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.41:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:49:40.696 7f122b279c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:44.696 7f122b279c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:49:44.697 7f122b279c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:49:44.697 7f122b279c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:49:44.697 7f122b279c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:49:44.697 7f122b279c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:49:44.697 7f122b279c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:49:44.697 7f122b279c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:49:44.698 7f122b279c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:49:44.698 7f122b279c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:44.698 7f122b279c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:49:44.698 7f122b279c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:44.698 7f122b279c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:44.698 7f122b279c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.23:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:49:44.698 7f122b279c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:48.699 7f122b279c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:49:48.700 7f122b279c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:49:48.700 7f122b279c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:49:48.700 7f122b279c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:49:48.700 7f122b279c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:49:48.700 7f122b279c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:49:48.700 7f122b279c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:49:48.701 7f122b279c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:49:48.701 7f122b279c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:48.701 7f122b279c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:49:48.701 7f122b279c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:48.701 7f122b279c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:48.701 7f122b279c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.38:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:49:48.701 7f122b279c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:52.701 7f122b279c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:49:52.702 7f122b279c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:49:52.702 7f122b279c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:49:52.702 7f122b279c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:49:52.702 7f122b279c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:49:52.703 7f122b279c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:49:52.703 7f122b279c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:49:52.703 7f122b279c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:49:52.703 7f122b279c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:52.703 7f122b279c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:49:52.703 7f122b279c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:52.703 7f122b279c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:52.703 7f122b279c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.41:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:49:52.703 7f122b279c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:55.826 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain',
             'default-project',
             'ip-fabric',
             '__default__',
             'cn-jenkins-deploy-platform-ansible-os-2696-2'],
 'obj_dict': {'bgp_router_parameters': {'address': '10.20.0.23',
                                        'address_families': {'family': ['route-target',
                                                                        'inet-vpn',
                                                                        'e-vpn',
                                                                        'erm-vpn',
                                                                        'inet6-vpn']},
                                        'admin_down': False,
                                        'auth_data': None,
                                        'autonomous_system': 64512,
                                        'cluster_id': None,
                                        'gateway_address': None,
                                        'hold_time': 0,
                                        'identifier': '10.20.0.23',
                                        'ipv6_gateway_address': None,
                                        'local_autonomous_system': None,
                                        'port': 179,
                                        'router_type': 'control-node',
                                        'source_port': None,
                                        'vendor': 'contrail'},
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-2696-2',
              'fq_name': ['default-domain',
                          'default-project',
                          'ip-fabric',
                          '__default__',
                          'cn-jenkins-deploy-platform-ansible-os-2696-2'],
              'id_perms': {'created': '2025-02-06T00:49:55.808288',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-02-06T00:49:55.808288',
                           'permissions': {'group': 'admin',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 13031345185215202771,
                                    'uuid_mslong': 10436060978557765762}},
              'parent_type': 'routing-instance',
              'parent_uuid': 'f64a9443-f9f4-4ba5-9e0b-59cc47ce62e9',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '90d4562a-d940-4882-b4d8-a367263fc5d3'},
 'oper': 'CREATE',
 'request-id': 'req-121c5fa8-fce9-4338-b309-7a51ca4c6ef8',
 'type': 'bgp_router',
 'uuid': '90d4562a-d940-4882-b4d8-a367263fc5d3'}
02/06/2025 00:49:56.086 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'],
 'oper': 'UPDATE',
 'request-id': 'req-0a30c213-56af-41fd-bb9f-84ab27a6d6a6',
 'type': 'global_system_config',
 'uuid': 'ba1a960e-0268-48a5-966b-9232237b8892'}
02/06/2025 00:49:56.609 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain',
             'default-project',
             'ip-fabric',
             '__default__',
             'cn-jenkins-deploy-platform-ansible-os-2696-3'],
 'obj_dict': {'bgp_router_parameters': {'address': '10.20.0.10',
                                        'address_families': {'family': ['route-target',
                                                                        'inet-vpn',
                                                                        'e-vpn',
                                                                        'erm-vpn',
                                                                        'inet6-vpn']},
                                        'admin_down': False,
                                        'auth_data': None,
                                        'autonomous_system': 64512,
                                        'cluster_id': None,
                                        'gateway_address': None,
                                        'hold_time': 0,
                                        'identifier': '10.20.0.10',
                                        'ipv6_gateway_address': None,
                                        'local_autonomous_system': None,
                                        'port': 179,
                                        'router_type': 'control-node',
                                        'source_port': None,
                                        'vendor': 'contrail'},
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-2696-3',
              'fq_name': ['default-domain',
                          'default-project',
                          'ip-fabric',
                          '__default__',
                          'cn-jenkins-deploy-platform-ansible-os-2696-3'],
              'id_perms': {'created': '2025-02-06T00:49:56.601155',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-02-06T00:49:56.601155',
                           'permissions': {'group': 'admin',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 11510064116962339877,
                                    'uuid_mslong': 1890109006912966068}},
              'parent_type': 'routing-instance',
              'parent_uuid': 'f64a9443-f9f4-4ba5-9e0b-59cc47ce62e9',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '1a3b0420-a7d0-4db4-9fbb-f654d982ac25'},
 'oper': 'CREATE',
 'request-id': 'req-08bf52ad-5987-4c0f-b15c-a205a94b79bc',
 'type': 'bgp_router',
 'uuid': '1a3b0420-a7d0-4db4-9fbb-f654d982ac25'}
02/06/2025 00:49:56.672 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain',
             'default-project',
             'ip-fabric',
             '__default__',
             'cn-jenkins-deploy-platform-ansible-os-2696-3'],
 'oper': 'UPDATE',
 'request-id': 'req-bf892854-0277-464e-91c4-a9b26384f06d',
 'type': 'bgp_router',
 'uuid': '1a3b0420-a7d0-4db4-9fbb-f654d982ac25'}
02/06/2025 00:49:56.680 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain',
             'default-project',
             'ip-fabric',
             '__default__',
             'cn-jenkins-deploy-platform-ansible-os-2696-2'],
 'oper': 'UPDATE-IMPLICIT',
 'request-id': 'req-bf892854-0277-464e-91c4-a9b26384f06d',
 'type': 'bgp_router',
 'uuid': '90d4562a-d940-4882-b4d8-a367263fc5d3'}
02/06/2025 00:49:56.687 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain',
             'default-project',
             'ip-fabric',
             '__default__',
             'cn-jenkins-deploy-platform-ansible-os-2696-1'],
 'obj_dict': {'bgp_router_parameters': {'address': '10.20.0.14',
                                        'address_families': {'family': ['route-target',
                                                                        'inet-vpn',
                                                                        'e-vpn',
                                                                        'erm-vpn',
                                                                        'inet6-vpn']},
                                        'admin_down': False,
                                        'auth_data': None,
                                        'autonomous_system': 64512,
                                        'cluster_id': None,
                                        'gateway_address': None,
                                        'hold_time': 0,
                                        'identifier': '10.20.0.14',
                                        'ipv6_gateway_address': None,
                                        'local_autonomous_system': None,
                                        'port': 179,
                                        'router_type': 'control-node',
                                        'source_port': None,
                                        'vendor': 'contrail'},
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-2696-1',
              'fq_name': ['default-domain',
                          'default-project',
                          'ip-fabric',
                          '__default__',
                          'cn-jenkins-deploy-platform-ansible-os-2696-1'],
              'id_perms': {'created': '2025-02-06T00:49:56.668063',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-02-06T00:49:56.668063',
                           'permissions': {'group': 'admin',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 12518061024783969682,
                                    'uuid_mslong': 3193704981221755388}},
              'parent_type': 'routing-instance',
              'parent_uuid': 'f64a9443-f9f4-4ba5-9e0b-59cc47ce62e9',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '2c5251c2-6b1e-49fc-adb9-162db2e92d92'},
 'oper': 'CREATE',
 'request-id': 'req-87ec2fbd-a706-4495-8d3c-e38e9c0efe44',
 'type': 'bgp_router',
 'uuid': '2c5251c2-6b1e-49fc-adb9-162db2e92d92'}
02/06/2025 00:49:56.702 7f122a180f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:49:56.703 7f122a180f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:49:56.703 7f122a180f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:49:56.704 7f122a180f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:49:56.704 7f122a180f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:49:56.704 7f122a180f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:49:56.704 7f122a180f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:49:56.704 7f122a180f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:49:56.704 7f122a180f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:56.704 7f122a180f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:49:56.704 7f122a180f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:56.704 7f122a180f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:56.704 7f122a180f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.23:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:49:56.704 7f122a180f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:49:56.735 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain',
             'default-project',
             'ip-fabric',
             '__default__',
             'cn-jenkins-deploy-platform-ansible-os-2696-1'],
 'oper': 'UPDATE',
 'request-id': 'req-a761f700-80cf-4939-b560-e952f956cec5',
 'type': 'bgp_router',
 'uuid': '2c5251c2-6b1e-49fc-adb9-162db2e92d92'}
02/06/2025 00:49:56.744 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain',
             'default-project',
             'ip-fabric',
             '__default__',
             'cn-jenkins-deploy-platform-ansible-os-2696-2'],
 'oper': 'UPDATE-IMPLICIT',
 'request-id': 'req-a761f700-80cf-4939-b560-e952f956cec5',
 'type': 'bgp_router',
 'uuid': '90d4562a-d940-4882-b4d8-a367263fc5d3'}
02/06/2025 00:49:56.793 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain',
             'default-project',
             'ip-fabric',
             '__default__',
             'cn-jenkins-deploy-platform-ansible-os-2696-1'],
 'oper': 'UPDATE',
 'request-id': 'req-d96fdb8e-3eb3-4177-b457-b6307191553a',
 'type': 'bgp_router',
 'uuid': '2c5251c2-6b1e-49fc-adb9-162db2e92d92'}
02/06/2025 00:49:56.809 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain',
             'default-project',
             'ip-fabric',
             '__default__',
             'cn-jenkins-deploy-platform-ansible-os-2696-3'],
 'oper': 'UPDATE-IMPLICIT',
 'request-id': 'req-d96fdb8e-3eb3-4177-b457-b6307191553a',
 'type': 'bgp_router',
 'uuid': '1a3b0420-a7d0-4db4-9fbb-f654d982ac25'}
02/06/2025 00:49:56.848 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'],
 'oper': 'UPDATE',
 'request-id': 'req-1b78862f-8eb9-4be1-887b-a8cf032e869b',
 'type': 'global_system_config',
 'uuid': 'ba1a960e-0268-48a5-966b-9232237b8892'}
02/06/2025 00:49:56.945 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'],
 'oper': 'UPDATE',
 'request-id': 'req-977fefa6-2833-42be-beb3-e457c29be2cc',
 'type': 'global_system_config',
 'uuid': 'ba1a960e-0268-48a5-966b-9232237b8892'}
02/06/2025 00:50:00.705 7f1229ec98d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:50:00.706 7f1229ec98d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:50:00.706 7f1229ec98d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:50:00.706 7f1229ec98d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:50:00.706 7f1229ec98d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:50:00.706 7f1229ec98d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:50:00.706 7f1229ec98d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:50:00.706 7f1229ec98d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:50:00.707 7f1229ec98d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:00.707 7f1229ec98d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:50:00.707 7f1229ec98d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:00.707 7f1229ec98d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:00.707 7f1229ec98d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.38:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:50:00.707 7f1229ec98d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:04.707 7f1229e89c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:50:04.709 7f1229e89c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:50:04.709 7f1229e89c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:50:04.709 7f1229e89c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:50:04.709 7f1229e89c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:50:04.709 7f1229e89c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:50:04.709 7f1229e89c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:50:04.709 7f1229e89c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:50:04.709 7f1229e89c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:04.710 7f1229e89c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:50:04.710 7f1229e89c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:04.710 7f1229e89c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:04.710 7f1229e89c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.41:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:50:04.710 7f1229e89c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:08.710 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:50:08.711 7f1229f1f2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:50:08.711 7f1229f1f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:50:08.711 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:50:08.711 7f1229f1f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:50:08.711 7f1229f1f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:50:08.711 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:50:08.712 7f1229f1f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:50:08.712 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:08.712 7f1229f1f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:50:08.712 7f1229f1f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:08.712 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:08.712 7f1229f1f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.23:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:50:08.712 7f1229f1f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:12.712 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:50:12.715 7f1229f1f2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:50:12.715 7f1229f1f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:50:12.715 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:50:12.715 7f1229f1f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:50:12.715 7f1229f1f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:50:12.715 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:50:12.716 7f1229f1f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:50:12.716 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:12.716 7f1229f1f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:50:12.716 7f1229f1f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:12.716 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:12.716 7f1229f1f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.38:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:50:12.716 7f1229f1f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:16.716 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:50:16.717 7f1229f1f2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:50:16.717 7f1229f1f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:50:16.717 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:50:16.718 7f1229f1f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:50:16.718 7f1229f1f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:50:16.718 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:50:16.718 7f1229f1f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:50:16.718 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:16.718 7f1229f1f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:50:16.718 7f1229f1f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:16.718 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:16.718 7f1229f1f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.41:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:50:16.718 7f1229f1f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:20.718 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:50:20.720 7f1229f1f2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:50:20.720 7f1229f1f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:50:20.720 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:50:20.720 7f1229f1f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:50:20.720 7f1229f1f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:50:20.720 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:50:20.720 7f1229f1f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:50:20.720 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:20.721 7f1229f1f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:50:20.721 7f1229f1f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:20.721 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:20.721 7f1229f1f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.23:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:50:20.721 7f1229f1f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:24.721 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:50:24.722 7f1229f1f2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:50:24.722 7f1229f1f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:50:24.722 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:50:24.722 7f1229f1f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:50:24.723 7f1229f1f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:50:24.723 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:50:24.723 7f1229f1f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:50:24.723 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:24.723 7f1229f1f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:50:24.723 7f1229f1f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:24.723 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:24.723 7f1229f1f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.38:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:50:24.723 7f1229f1f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:28.723 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:50:28.724 7f1229f1f2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:50:28.724 7f1229f1f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:50:28.724 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:50:28.724 7f1229f1f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:50:28.724 7f1229f1f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:50:28.724 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:50:28.725 7f1229f1f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:50:28.725 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:28.725 7f1229f1f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:50:28.725 7f1229f1f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:28.725 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:28.725 7f1229f1f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.41:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:50:28.725 7f1229f1f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:32.726 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:50:32.727 7f1229f1f2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:50:32.728 7f1229f1f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:50:32.728 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:50:32.728 7f1229f1f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:50:32.728 7f1229f1f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:50:32.728 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:50:32.728 7f1229f1f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:50:32.728 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:32.728 7f1229f1f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:50:32.728 7f1229f1f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:32.729 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:32.729 7f1229f1f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.23:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:50:32.729 7f1229f1f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:36.729 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:50:36.730 7f1229f1f2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:50:36.730 7f1229f1f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:50:36.730 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:50:36.730 7f1229f1f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:50:36.730 7f1229f1f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:50:36.730 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:50:36.731 7f1229f1f2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:50:36.731 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:36.731 7f1229f1f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:50:36.731 7f1229f1f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:36.731 7f1229f1f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:36.731 7f1229f1f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.38:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:50:36.731 7f1229f1f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:40.730 7f1229ed44e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:50:40.731 7f1229ed44e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:50:40.732 7f1229ed44e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:50:40.732 7f1229ed44e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:50:40.732 7f1229ed44e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:50:40.732 7f1229ed44e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:50:40.732 7f1229ed44e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:50:40.732 7f1229ed44e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:50:40.732 7f1229ed44e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:40.732 7f1229ed44e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:50:40.732 7f1229ed44e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:40.732 7f1229ed44e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:40.733 7f1229ed44e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.41:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:50:40.733 7f1229ed44e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:44.733 7f1229ed44e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:50:44.734 7f1229ed44e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:50:44.734 7f1229ed44e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:50:44.734 7f1229ed44e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:50:44.734 7f1229ed44e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:50:44.734 7f1229ed44e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:50:44.734 7f1229ed44e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:50:44.735 7f1229ed44e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:50:44.735 7f1229ed44e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:44.735 7f1229ed44e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:50:44.735 7f1229ed44e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:44.735 7f1229ed44e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:44.735 7f1229ed44e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.23:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:50:44.735 7f1229ed44e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:48.735 7f1229ed44e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:50:48.736 7f1229ed44e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:50:48.736 7f1229ed44e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:50:48.737 7f1229ed44e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:50:48.737 7f1229ed44e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:50:48.737 7f1229ed44e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:50:48.737 7f1229ed44e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:50:48.737 7f1229ed44e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:50:48.737 7f1229ed44e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:48.737 7f1229ed44e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:50:48.737 7f1229ed44e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:48.737 7f1229ed44e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:48.737 7f1229ed44e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.38:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:50:48.738 7f1229ed44e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:52.737 7f1229ed44e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:50:52.739 7f1229ed44e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:50:52.739 7f1229ed44e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:50:52.739 7f1229ed44e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:50:52.740 7f1229ed44e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:50:52.740 7f1229ed44e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:50:52.740 7f1229ed44e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:50:52.740 7f1229ed44e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:50:52.740 7f1229ed44e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:52.740 7f1229ed44e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:50:52.740 7f1229ed44e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:52.740 7f1229ed44e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:52.740 7f1229ed44e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.41:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:50:52.740 7f1229ed44e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:55.487 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-2696-2.'],
 'obj_dict': {'database_node_ip_address': '10.0.0.41',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-2696-2.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-2696-2.'],
              'id_perms': {'created': '2025-02-06T00:50:55.468234',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-02-06T00:50:55.468234',
                           'permissions': {'group': 'admin',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 10798001892401377517,
                                    'uuid_mslong': 2524915782669256069}},
              'parent_type': 'global-system-config',
              'parent_uuid': 'ba1a960e-0268-48a5-966b-9232237b8892',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '230a4d86-d9c7-4585-95da-3582c89470ed'},
 'oper': 'CREATE',
 'request-id': 'req-c8790aa8-0a31-4b40-a4e0-e6ff79da6098',
 'type': 'database_node',
 'uuid': '230a4d86-d9c7-4585-95da-3582c89470ed'}
02/06/2025 00:50:55.541 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-2696-3.'],
 'obj_dict': {'database_node_ip_address': '10.0.0.38',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-2696-3.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-2696-3.'],
              'id_perms': {'created': '2025-02-06T00:50:55.520384',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-02-06T00:50:55.520384',
                           'permissions': {'group': 'admin',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 10764911271832551091,
                                    'uuid_mslong': 5897299230308190913}},
              'parent_type': 'global-system-config',
              'parent_uuid': 'ba1a960e-0268-48a5-966b-9232237b8892',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '51d76a67-9cb4-4ac1-9564-a5c44c2d7eb3'},
 'oper': 'CREATE',
 'request-id': 'req-dcff6abf-2723-4bbe-b81c-68e1e0b45412',
 'type': 'database_node',
 'uuid': '51d76a67-9cb4-4ac1-9564-a5c44c2d7eb3'}
02/06/2025 00:50:55.623 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-2696-1.'],
 'obj_dict': {'database_node_ip_address': '10.0.0.23',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-2696-1.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-2696-1.'],
              'id_perms': {'created': '2025-02-06T00:50:55.605625',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-02-06T00:50:55.605625',
                           'permissions': {'group': 'admin',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 10105372610550067841,
                                    'uuid_mslong': 4566232245450721201}},
              'parent_type': 'global-system-config',
              'parent_uuid': 'ba1a960e-0268-48a5-966b-9232237b8892',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '3f5e8408-c806-47b1-8c3d-7ed946cc7281'},
 'oper': 'CREATE',
 'request-id': 'req-91aa1670-b2cf-4b24-b0f3-fad4f35bb855',
 'type': 'database_node',
 'uuid': '3f5e8408-c806-47b1-8c3d-7ed946cc7281'}
02/06/2025 00:50:56.740 7f122c1d3c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:50:56.742 7f122c1d3c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:50:56.742 7f122c1d3c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:50:56.743 7f122c1d3c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:50:56.743 7f122c1d3c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:50:56.743 7f122c1d3c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:50:56.743 7f122c1d3c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:50:56.743 7f122c1d3c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:50:56.744 7f122c1d3c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:56.744 7f122c1d3c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:50:56.744 7f122c1d3c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:56.744 7f122c1d3c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:50:56.744 7f122c1d3c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.23:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:50:56.744 7f122c1d3c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:00.742 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:51:00.743 7f122b2916d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:51:00.743 7f122b2916d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:51:00.743 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:51:00.743 7f122b2916d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:51:00.743 7f122b2916d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:51:00.743 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:51:00.744 7f122b2916d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:51:00.744 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:00.744 7f122b2916d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:51:00.744 7f122b2916d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:00.744 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:00.744 7f122b2916d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.38:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:51:00.744 7f122b2916d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:04.744 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:51:04.745 7f122b2916d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:51:04.745 7f122b2916d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:51:04.745 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:51:04.745 7f122b2916d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:51:04.745 7f122b2916d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:51:04.745 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:51:04.745 7f122b2916d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:51:04.745 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:04.746 7f122b2916d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:51:04.746 7f122b2916d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:04.746 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:04.746 7f122b2916d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.41:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:51:04.746 7f122b2916d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:08.746 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:51:08.747 7f122b2916d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:51:08.747 7f122b2916d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:51:08.747 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:51:08.748 7f122b2916d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:51:08.748 7f122b2916d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:51:08.748 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:51:08.748 7f122b2916d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:51:08.748 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:08.748 7f122b2916d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:51:08.748 7f122b2916d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:08.748 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:08.748 7f122b2916d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.23:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:51:08.748 7f122b2916d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:12.749 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:51:12.750 7f122b2916d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:51:12.750 7f122b2916d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:51:12.750 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:51:12.750 7f122b2916d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:51:12.750 7f122b2916d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:51:12.750 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:51:12.751 7f122b2916d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:51:12.751 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:12.751 7f122b2916d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:51:12.751 7f122b2916d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:12.751 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:12.751 7f122b2916d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.38:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:51:12.751 7f122b2916d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:16.751 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:51:16.752 7f122b2916d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:51:16.752 7f122b2916d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:51:16.752 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:51:16.752 7f122b2916d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:51:16.752 7f122b2916d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:51:16.753 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:51:16.753 7f122b2916d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:51:16.753 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:16.753 7f122b2916d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:51:16.753 7f122b2916d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:16.753 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:16.753 7f122b2916d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.41:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:51:16.753 7f122b2916d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:20.754 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:51:20.755 7f122b2916d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:51:20.755 7f122b2916d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:51:20.755 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:51:20.756 7f122b2916d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:51:20.756 7f122b2916d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:51:20.756 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:51:20.756 7f122b2916d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:51:20.756 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:20.756 7f122b2916d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:51:20.756 7f122b2916d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:20.756 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:20.756 7f122b2916d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.23:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:51:20.756 7f122b2916d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:24.757 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:51:24.758 7f122b2916d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:51:24.758 7f122b2916d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:51:24.758 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:51:24.758 7f122b2916d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:51:24.758 7f122b2916d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:51:24.758 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:51:24.759 7f122b2916d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:51:24.759 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:24.759 7f122b2916d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:51:24.759 7f122b2916d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:24.759 7f122b2916d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:24.759 7f122b2916d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.38:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:51:24.759 7f122b2916d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:28.758 7f1229f75048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:51:28.759 7f1229f75048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:51:28.760 7f1229f75048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:51:28.760 7f1229f75048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:51:28.760 7f1229f75048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:51:28.760 7f1229f75048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:51:28.760 7f1229f75048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:51:28.760 7f1229f75048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:51:28.760 7f1229f75048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:28.760 7f1229f75048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:51:28.760 7f1229f75048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:28.760 7f1229f75048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:28.761 7f1229f75048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.41:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:51:28.761 7f1229f75048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:32.761 7f122b349630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:51:32.762 7f122b349630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:51:32.762 7f122b349630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:51:32.762 7f122b349630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:51:32.763 7f122b349630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:51:32.763 7f122b349630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:51:32.763 7f122b349630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:51:32.763 7f122b349630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:51:32.763 7f122b349630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:32.763 7f122b349630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:51:32.763 7f122b349630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:32.763 7f122b349630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:32.763 7f122b349630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.23:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:51:32.763 7f122b349630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:36.764 7f122b349630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:51:36.765 7f122b349630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:51:36.765 7f122b349630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:51:36.765 7f122b349630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:51:36.765 7f122b349630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:51:36.765 7f122b349630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:51:36.765 7f122b349630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:51:36.765 7f122b349630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:51:36.766 7f122b349630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:36.766 7f122b349630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:51:36.766 7f122b349630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:36.766 7f122b349630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:36.766 7f122b349630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.38:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:51:36.766 7f122b349630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:40.765 7f1229fa7240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:51:40.766 7f1229fa7240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:51:40.766 7f1229fa7240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:51:40.767 7f1229fa7240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:51:40.767 7f1229fa7240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:51:40.767 7f1229fa7240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:51:40.767 7f1229fa7240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:51:40.767 7f1229fa7240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:51:40.767 7f1229fa7240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:40.767 7f1229fa7240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:51:40.767 7f1229fa7240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:40.767 7f1229fa7240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:40.767 7f1229fa7240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.41:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:51:40.767 7f1229fa7240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:44.767 7f1229fa7240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:51:44.769 7f1229fa7240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
02/06/2025 00:51:44.769 7f1229fa7240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:51:44.769 7f1229fa7240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:51:44.769 7f1229fa7240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:51:44.769 7f1229fa7240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:51:44.769 7f1229fa7240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
02/06/2025 00:51:44.769 7f1229fa7240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
02/06/2025 00:51:44.769 7f1229fa7240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:44.769 7f1229fa7240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
02/06/2025 00:51:44.770 7f1229fa7240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:44.770 7f1229fa7240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:44.770 7f1229fa7240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1738802880593853  collector_name =   collector_ip = 10.0.0.23:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.38:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
02/06/2025 00:51:44.770 7f1229fa7240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
02/06/2025 00:51:47.549 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-2696-3.'],
 'obj_dict': {'analytics_node_ip_address': '10.0.0.38',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-2696-3.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-2696-3.'],
              'id_perms': {'created': '2025-02-06T00:51:47.541027',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-02-06T00:51:47.541027',
                           'permissions': {'group': 'admin',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 12335472749547410451,
                                    'uuid_mslong': 5276339916293754616}},
              'parent_type': 'global-system-config',
              'parent_uuid': 'ba1a960e-0268-48a5-966b-9232237b8892',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '49395332-d8e7-4ef8-ab30-671c0d48d413'},
 'oper': 'CREATE',
 'request-id': 'req-79e60fea-c709-4be1-8805-7a757a8d7dc7',
 'type': 'analytics_node',
 'uuid': '49395332-d8e7-4ef8-ab30-671c0d48d413'}
02/06/2025 00:51:47.620 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-2696-2.'],
 'obj_dict': {'analytics_node_ip_address': '10.0.0.41',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-2696-2.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-2696-2.'],
              'id_perms': {'created': '2025-02-06T00:51:47.607224',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-02-06T00:51:47.607224',
                           'permissions': {'group': 'admin',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 10355276181774336725,
                                    'uuid_mslong': 554934841414733463}},
              'parent_type': 'global-system-config',
              'parent_uuid': 'ba1a960e-0268-48a5-966b-9232237b8892',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '07b3864c-5003-4e97-8fb5-54d29db902d5'},
 'oper': 'CREATE',
 'request-id': 'req-bc1c2194-26a3-4e61-a75b-734197812742',
 'type': 'analytics_node',
 'uuid': '07b3864c-5003-4e97-8fb5-54d29db902d5'}
02/06/2025 00:51:47.685 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-2696-1.'],
 'obj_dict': {'analytics_node_ip_address': '10.0.0.23',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-2696-1.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-2696-1.'],
              'id_perms': {'created': '2025-02-06T00:51:47.671223',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-02-06T00:51:47.671223',
                           'permissions': {'group': 'admin',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 11137361790792085528,
                                    'uuid_mslong': 3661068360803831213}},
              'parent_type': 'global-system-config',
              'parent_uuid': 'ba1a960e-0268-48a5-966b-9232237b8892',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '32ceba46-e822-4dad-9a8f-db8a5b2bb018'},
 'oper': 'CREATE',
 'request-id': 'req-b2fafcac-5b24-48f4-9497-e93807949e43',
 'type': 'analytics_node',
 'uuid': '32ceba46-e822-4dad-9a8f-db8a5b2bb018'}
02/06/2025 00:51:48.770 7f1229e38588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
02/06/2025 00:51:48.771 7f1229e38588 [contrail-device-manager] [INFO]: Session Event: TCP Connected
02/06/2025 00:51:48.772 7f1229e38588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
02/06/2025 00:51:48.772 7f1229e38588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:51:48.772 7f1229e38588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-2696-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.23:5673, 10.0.0.41:5673, 10.0.0.38:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.23:9041, 10.0.0.41:9041, 10.0.0.38:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.23:2181, 10.0.0.41:2181, 10.0.0.38:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.23,10.0.0.41,10.0.0.38:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
02/06/2025 00:51:48.772 7f1229e38588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
02/06/2025 00:51:48.772 7f1229e38588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnected] in state[Connect]
02/06/2025 00:51:48.772 7f1229e38588 [contrail-device-manager] [DEBUG]: Send sandesh control message. uve type count # 19
02/06/2025 00:51:48.772 7f1229e38588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit]
02/06/2025 00:51:48.772 7f1229e38588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit]
02/06/2025 00:51:48.773 7f1229e38588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit]
02/06/2025 00:51:48.773 7f122a180588 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG]
02/06/2025 00:51:48.774 7f122a180588 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID]
02/06/2025 00:51:59.095 7f1229e87c18 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001016
02/06/2025 00:51:59.096 7f1229e87c18 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient]
02/06/2025 00:51:59.096 7f1229e38588 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit]
02/06/2025 00:51:59.096 7f1229e38588 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 0
02/06/2025 00:51:59.096 7f1229e38588 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-2696-3.: 140> in the [ObjectConfigNode:NodeStatusUVE] map
02/06/2025 00:51:59.097 7f1229e38588 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0: 58> in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map
02/06/2025 00:51:59.097 7f1229e38588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established]
02/06/2025 00:51:59.097 7f122c16f198 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG]
02/06/2025 00:51:59.098 7f122c16f198 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID]
02/06/2025 00:52:07.477 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-2696-1.'],
 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.23',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-2696-1.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-2696-1.'],
              'id_perms': {'created': '2025-02-06T00:52:07.462545',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-02-06T00:52:07.462545',
                           'permissions': {'group': 'admin',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 9802141115219550267,
                                    'uuid_mslong': 17374098177735544662}},
              'parent_type': 'global-system-config',
              'parent_uuid': 'ba1a960e-0268-48a5-966b-9232237b8892',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'f11d323d-a0b0-4f56-8808-33690ae9a03b'},
 'oper': 'CREATE',
 'request-id': 'req-fc3e4be7-6d6c-4076-b4b6-20accb24f9b8',
 'type': 'analytics_alarm_node',
 'uuid': 'f11d323d-a0b0-4f56-8808-33690ae9a03b'}
02/06/2025 00:52:07.884 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-2696-2.'],
 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.41',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-2696-2.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-2696-2.'],
              'id_perms': {'created': '2025-02-06T00:52:07.868878',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-02-06T00:52:07.868878',
                           'permissions': {'group': 'admin',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 9382513485870274205,
                                    'uuid_mslong': 13168080257843480971}},
              'parent_type': 'global-system-config',
              'parent_uuid': 'ba1a960e-0268-48a5-966b-9232237b8892',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'b6be6b3a-1e98-498b-8235-624e019c169d'},
 'oper': 'CREATE',
 'request-id': 'req-e39bc79e-2ef5-4f29-8d44-7b7cbec94ad7',
 'type': 'analytics_alarm_node',
 'uuid': 'b6be6b3a-1e98-498b-8235-624e019c169d'}
02/06/2025 00:52:07.943 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-2696-3.'],
 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.38',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-2696-3.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-2696-3.'],
              'id_perms': {'created': '2025-02-06T00:52:07.913678',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-02-06T00:52:07.913678',
                           'permissions': {'group': 'admin',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 11466234370457312759,
                                    'uuid_mslong': 14000137601757826758}},
              'parent_type': 'global-system-config',
              'parent_uuid': 'ba1a960e-0268-48a5-966b-9232237b8892',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'c24a7af9-0f5d-4ec6-9f20-3f68c27b9df7'},
 'oper': 'CREATE',
 'request-id': 'req-aa046e0d-560c-4a12-8bfb-e357ecf939bd',
 'type': 'analytics_alarm_node',
 'uuid': 'c24a7af9-0f5d-4ec6-9f20-3f68c27b9df7'}
02/06/2025 00:52:09.402 7f1229e87c18 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001297
02/06/2025 00:52:09.402 7f1229e87c18 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient]
02/06/2025 00:52:09.403 7f1230efeeb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established]
02/06/2025 00:52:09.403 7f1230efeeb8 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 2
02/06/2025 00:52:09.403 7f1230efeeb8 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-2696-3.: 141> in the [ObjectConfigNode:NodeStatusUVE] map
02/06/2025 00:52:09.403 7f1230efeeb8 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-2696-3.:Config:contrail-device-manager:0: 59> in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map
02/06/2025 00:52:23.917 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-2696-1.'],
 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.23',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-2696-1.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-2696-1.'],
              'id_perms': {'created': '2025-02-06T00:52:23.896854',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-02-06T00:52:23.896854',
                           'permissions': {'group': 'admin',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 13818419799014789627,
                                    'uuid_mslong': 5713497505779042531}},
              'parent_type': 'global-system-config',
              'parent_uuid': 'ba1a960e-0268-48a5-966b-9232237b8892',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '4f4a6bb5-c90a-48e3-bfc4-e398158051fb'},
 'oper': 'CREATE',
 'request-id': 'req-8d231066-508b-4ca1-9b99-744c283a5eda',
 'type': 'analytics_snmp_node',
 'uuid': '4f4a6bb5-c90a-48e3-bfc4-e398158051fb'}
02/06/2025 00:52:23.936 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-2696-2.'],
 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.41',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-2696-2.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-2696-2.'],
              'id_perms': {'created': '2025-02-06T00:52:23.900467',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-02-06T00:52:23.900467',
                           'permissions': {'group': 'admin',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 12812512267369629052,
                                    'uuid_mslong': 16302052915193004682}},
              'parent_type': 'global-system-config',
              'parent_uuid': 'ba1a960e-0268-48a5-966b-9232237b8892',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'e23c86c1-1fb3-428a-b1cf-300608e6c57c'},
 'oper': 'CREATE',
 'request-id': 'req-894194e4-396a-4fc1-9efc-471f36dca40f',
 'type': 'analytics_snmp_node',
 'uuid': 'e23c86c1-1fb3-428a-b1cf-300608e6c57c'}
02/06/2025 00:52:23.991 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-2696-3.'],
 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.38',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-2696-3.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-2696-3.'],
              'id_perms': {'created': '2025-02-06T00:52:23.981930',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-02-06T00:52:23.981930',
                           'permissions': {'group': 'admin',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 13053270573122371646,
                                    'uuid_mslong': 12255450726305516863}},
              'parent_type': 'global-system-config',
              'parent_uuid': 'ba1a960e-0268-48a5-966b-9232237b8892',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'aa141b80-dfbe-4d3f-b526-886d5404c03e'},
 'oper': 'CREATE',
 'request-id': 'req-a6754060-7e05-4b82-98b7-be5cf0fbb504',
 'type': 'analytics_snmp_node',
 'uuid': 'aa141b80-dfbe-4d3f-b526-886d5404c03e'}
02/06/2025 00:54:17.813 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'],
 'oper': 'UPDATE',
 'request-id': 'req-5b319241-02cd-4dfa-9a0f-e0a381f36798',
 'type': 'global_system_config',
 'uuid': 'ba1a960e-0268-48a5-966b-9232237b8892'}
02/06/2025 00:54:17.880 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'],
 'oper': 'UPDATE',
 'request-id': 'req-1431c6e3-e0d4-42fb-b138-8fde160d07cd',
 'type': 'global_system_config',
 'uuid': 'ba1a960e-0268-48a5-966b-9232237b8892'}
02/06/2025 00:54:17.941 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-2696-1'],
 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-2696-1',
              'fq_name': ['default-global-system-config',
                          'an-jenkins-deploy-platform-ansible-os-2696-1'],
              'id_perms': {'created': '2025-02-06T00:54:17.931930',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-02-06T00:54:17.931930',
                           'permissions': {'group': 'reader',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 13496164296973936568,
                                    'uuid_mslong': 770411036172699811}},
              'parent_type': 'global-system-config',
              'parent_uuid': 'ba1a960e-0268-48a5-966b-9232237b8892',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '0ab10cc1-6e1d-48a3-bb4c-01ec1f70e7b8',
              'virtual_router_dpdk_enabled': False,
              'virtual_router_ip_address': '10.20.0.22'},
 'oper': 'CREATE',
 'request-id': 'req-6fb5de43-4034-4639-940b-e0213e63c0b7',
 'type': 'virtual_router',
 'uuid': '0ab10cc1-6e1d-48a3-bb4c-01ec1f70e7b8'}
02/06/2025 00:54:18.004 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-2696-2'],
 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-2696-2',
              'fq_name': ['default-global-system-config',
                          'an-jenkins-deploy-platform-ansible-os-2696-2'],
              'id_perms': {'created': '2025-02-06T00:54:17.994434',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-02-06T00:54:17.994434',
                           'permissions': {'group': 'reader',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 12869627379161104614,
                                    'uuid_mslong': 3520518996431948288}},
              'parent_type': 'global-system-config',
              'parent_uuid': 'ba1a960e-0268-48a5-966b-9232237b8892',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '30db655f-ef57-4a00-b29a-19ea468a00e6',
              'virtual_router_dpdk_enabled': False,
              'virtual_router_ip_address': '10.20.0.18'},
 'oper': 'CREATE',
 'request-id': 'req-47bce8ab-1e9c-4150-b2a7-dbf77343fe4f',
 'type': 'virtual_router',
 'uuid': '30db655f-ef57-4a00-b29a-19ea468a00e6'}
02/06/2025 00:54:18.286 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-2696-1',
             'vhost0'],
 'obj_dict': {'display_name': 'vhost0',
              'fq_name': ['default-global-system-config',
                          'an-jenkins-deploy-platform-ansible-os-2696-1',
                          'vhost0'],
              'id_perms': {'created': '2025-02-06T00:54:18.265630',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-02-06T00:54:18.265630',
                           'permissions': {'group': 'reader',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 10935968442546006586,
                                    'uuid_mslong': 13185043804781364858}},
              'parent_type': 'virtual-router',
              'parent_uuid': '0ab10cc1-6e1d-48a3-bb4c-01ec1f70e7b8',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'b6faaf7b-abf5-467a-97c4-5d5b74d62a3a',
              'virtual_machine_interface_disable_policy': True,
              'virtual_machine_interface_mac_addresses': {'mac_address': ['02:b6:fa:af:7b:ab']},
              'virtual_network_refs': [{'to': ['default-domain',
                                               'default-project',
                                               'ip-fabric'],
                                        'uuid': '282c5778-ba76-4af1-b233-11cacfbeed4a'}]},
 'oper': 'CREATE',
 'request-id': 'req-7339d7c4-8237-4325-9377-2b5a1a1a6dbd',
 'type': 'virtual_machine_interface',
 'uuid': 'b6faaf7b-abf5-467a-97c4-5d5b74d62a3a'}
02/06/2025 00:54:18.331 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-2696-1',
             'vhost0'],
 'oper': 'UPDATE',
 'request-id': 'req-7339d7c4-8237-4325-9377-2b5a1a1a6dbd',
 'type': 'virtual_machine_interface',
 'uuid': 'b6faaf7b-abf5-467a-97c4-5d5b74d62a3a'}
02/06/2025 00:54:18.383 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-2696-2',
             'vhost0'],
 'obj_dict': {'display_name': 'vhost0',
              'fq_name': ['default-global-system-config',
                          'an-jenkins-deploy-platform-ansible-os-2696-2',
                          'vhost0'],
              'id_perms': {'created': '2025-02-06T00:54:18.360134',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-02-06T00:54:18.360134',
                           'permissions': {'group': 'reader',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 11275596502540104010,
                                    'uuid_mslong': 7495040932984930557}},
              'parent_type': 'virtual-router',
              'parent_uuid': '30db655f-ef57-4a00-b29a-19ea468a00e6',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '6803bc04-a394-40fd-9c7a-f747448a314a',
              'virtual_machine_interface_disable_policy': True,
              'virtual_machine_interface_mac_addresses': {'mac_address': ['02:68:03:bc:04:a3']},
              'virtual_network_refs': [{'to': ['default-domain',
                                               'default-project',
                                               'ip-fabric'],
                                        'uuid': '282c5778-ba76-4af1-b233-11cacfbeed4a'}]},
 'oper': 'CREATE',
 'request-id': 'req-da6cddab-28b8-4bce-bdc6-9eda843e3a75',
 'type': 'virtual_machine_interface',
 'uuid': '6803bc04-a394-40fd-9c7a-f747448a314a'}
02/06/2025 00:54:18.419 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-2696-2',
             'vhost0'],
 'oper': 'UPDATE',
 'request-id': 'req-da6cddab-28b8-4bce-bdc6-9eda843e3a75',
 'type': 'virtual_machine_interface',
 'uuid': '6803bc04-a394-40fd-9c7a-f747448a314a'}
02/06/2025 00:54:18.846 7f1229efbe10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'],
 'oper': 'UPDATE',
 'request-id': 'req-60f96f07-a5d8-47c7-bc82-ad2cff1114cf',
 'type': 'access_control_list',
 'uuid': 'f0daa14a-a0fa-4202-8f86-60cedb4ecc04'}
02/06/2025 00:54:52.683 7f1229e88c18 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-2696-3.: 141> in the [ObjectConfigNode:NodeStatusUVE] map
02/06/2025 00:55:18.315 7f122a15bc18 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-2696-3.: 141> in the [ObjectConfigNode:NodeStatusUVE] map