05/08/2025 00:57:38.052 7fa82c0d2c88 [contrail-device-manager] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0]
05/08/2025 00:57:38.052 7fa82c0d2c88 [contrail-device-manager] [INFO]: SANDESH: Trace: PRINT: [None] -> [False]
05/08/2025 00:57:38.052 7fa82c0d2c88 [contrail-device-manager] [INFO]: SANDESH: Flow Logging: [None] -> [False]
05/08/2025 00:57:38.052 7fa8237b02e8 [contrail-device-manager] [INFO]: Processing event[EvStart] in state[none]
05/08/2025 00:57:38.053 7fa8237b02e8 [contrail-device-manager] [DEBUG]: Add uve <cn-jenkins-deploy-platform-ansible-os-3284-2., 1> in the [ObjectConfigNode:NodeStatusUVE] map
05/08/2025 00:57:38.053 7fa8237b02e8 [contrail-device-manager] [DEBUG]: Add uve <cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0, 1> in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map
05/08/2025 00:57:38.053 7fa8237b02e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle]
05/08/2025 00:57:38.053 7fa8237b02e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:38.053 7fa8237b02e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>,  ]  description = Collector:Collector[none to Idle on EvStart] connection down  >>,  ]  >>  
05/08/2025 00:57:38.053 7fa8237b02e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:38.053 7fa8237b02e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:38.053 7fa8237b02e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  start_time = 1746665858053223  collector_name =   collector_ip =   collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 1  >>  
05/08/2025 00:57:38.053 7fa8237b02e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:38.096 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.56:5673//', 'pyamqp://guest:guest@10.0.0.33:5673//', 'pyamqp://guest:guest@10.0.0.249:5673//']
05/08/2025 00:57:38.105 7fa82c0d2c88 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down
05/08/2025 00:57:38.105 7fa823703588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:38.105 7fa823703588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down  >>,  ]  >>  
05/08/2025 00:57:38.105 7fa823703588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:38.105 7fa823703588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:38.106 7fa823703588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Down  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down  >>,  ]  >>  
05/08/2025 00:57:38.106 7fa823703588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:38.110 7fa82c0d2c88 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.56:5673// at 0x7fa8237a6e48>
05/08/2025 00:57:38.111 7fa823703240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:38.111 7fa823703240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart] connection down  >>,  ]  >>  
05/08/2025 00:57:38.111 7fa823703240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:38.142 7fa82c0d2c88 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down
05/08/2025 00:57:38.142 7fa8237030f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:38.143 7fa8237030f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Down  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down  >>,  ]  >>  
05/08/2025 00:57:38.143 7fa8237030f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:38.146 7fa82c0d2c88 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.56:5673// at 0x7fa82372bfd0>
05/08/2025 00:57:38.150 7fa831fb5978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:38.151 7fa831fb5978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart] connection down  >>,  ]  >>  
05/08/2025 00:57:38.151 7fa831fb5978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:38.163 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Removed remaining AMQP queue from previous run
05/08/2025 00:57:38.163 7fa82c0d2c88 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql
05/08/2025 00:57:38.163 7fa82c0d2c88 [contrail-device-manager] [WARNING]: initializing cassandra cluster
05/08/2025 00:57:38.163 7fa82c0d2c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create
05/08/2025 00:57:38.164 7fa82903b6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting consumer greenlet
05/08/2025 00:57:38.164 7fa82903b6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection
05/08/2025 00:57:38.164 7fa825f49978 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting publisher greenlet
05/08/2025 00:57:38.164 7fa825f49978 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Publisher connection
05/08/2025 00:57:38.164 7fa823599588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:38.164 7fa823599588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down  >>,  ]  >>  
05/08/2025 00:57:38.164 7fa823599588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:38.165 7fa82c0d2c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created
05/08/2025 00:57:38.170 7fa82903b6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established <Connection: amqp://guest:**@10.0.0.56:5673// at 0x7fa82359d438>
05/08/2025 00:57:38.170 7fa82903b6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Waiting for consumer
05/08/2025 00:57:38.170 7fa825f49978 [contrail-device-manager] [INFO]: KombuAmqpClient: Publisher connection established <Connection: amqp://guest:**@10.0.0.56:5673// at 0x7fa82359d438>
05/08/2025 00:57:38.216 7fa82c0d2c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected
05/08/2025 00:57:38.217 7fa8234ef828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:38.217 7fa8234ef828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[], Zookeeper:Zookeeper[] connection down  >>,  ]  >>  
05/08/2025 00:57:38.217 7fa8234ef828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:38.224 7fa82c0d2c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS
05/08/2025 00:57:38.224 7fa8234b7240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:38.224 7fa8234b7240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down  >>,  ]  >>  
05/08/2025 00:57:38.224 7fa8234b7240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:38.234 7fa82c0d2c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready
05/08/2025 00:57:38.260 7fa82c0d2c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready
05/08/2025 00:57:39.760 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
05/08/2025 00:57:40.681 7fa82c0d2c88 [contrail-device-manager] [WARNING]: table 'obj_uuid_table', created
05/08/2025 00:57:40.686 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
05/08/2025 00:57:41.597 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
05/08/2025 00:57:42.053 7fa8234772e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:57:42.054 7fa8234772e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:57:42.054 7fa8234772e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:57:42.054 7fa8234772e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:57:42.054 7fa8234772e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.33:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
05/08/2025 00:57:42.054 7fa8234772e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:57:42.055 7fa8234772e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:57:42.055 7fa8234772e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:57:42.055 7fa8234772e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:42.055 7fa8234772e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.33:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
05/08/2025 00:57:42.055 7fa8234772e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:42.055 7fa8234772e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:42.055 7fa8234772e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.33:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:57:42.055 7fa8234772e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:42.293 7fa82c0d2c88 [contrail-device-manager] [WARNING]: table 'obj_uuid_table' fixed with properties {'gc_grace_seconds': 864000}
05/08/2025 00:57:42.297 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
05/08/2025 00:57:43.368 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
05/08/2025 00:57:43.902 7fa82c0d2c88 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table', created
05/08/2025 00:57:43.906 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
05/08/2025 00:57:45.289 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
05/08/2025 00:57:45.762 7fa82c0d2c88 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table' fixed with properties {'gc_grace_seconds': 864000}
05/08/2025 00:57:45.766 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
05/08/2025 00:57:46.055 7fa8234a2c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:57:46.056 7fa8234a2c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:57:46.057 7fa8234a2c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:57:46.057 7fa8234a2c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:57:46.057 7fa8234a2c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
05/08/2025 00:57:46.057 7fa8234a2c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:57:46.057 7fa8234a2c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:57:46.057 7fa8234a2c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:57:46.057 7fa8234a2c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:46.057 7fa8234a2c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
05/08/2025 00:57:46.057 7fa8234a2c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:46.057 7fa8234a2c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:46.058 7fa8234a2c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.249:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:57:46.058 7fa8234a2c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:47.704 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
05/08/2025 00:57:47.706 7fa82c0d2c88 [contrail-device-manager] [WARNING]: table 'obj_shared_table', created
05/08/2025 00:57:47.710 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
05/08/2025 00:57:49.771 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
05/08/2025 00:57:50.057 7fa82347d2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:57:50.059 7fa82347d2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:57:50.059 7fa82347d2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:57:50.059 7fa82347d2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:57:50.059 7fa82347d2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.56:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
05/08/2025 00:57:50.059 7fa82347d2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:57:50.059 7fa82347d2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:57:50.059 7fa82347d2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:57:50.059 7fa82347d2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:50.059 7fa82347d2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.56:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
05/08/2025 00:57:50.060 7fa82347d2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:50.060 7fa82347d2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:50.060 7fa82347d2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.56:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:57:50.060 7fa82347d2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:50.662 7fa82c0d2c88 [contrail-device-manager] [WARNING]: table 'obj_shared_table' fixed with properties {'gc_grace_seconds': 864000}
05/08/2025 00:57:50.666 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
05/08/2025 00:57:50.666 7fa82349f630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:50.667 7fa82349f630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.56:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:57:50.667 7fa82349f630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:50.704 7fa82c0d2c88 [contrail-device-manager] [ERROR]: Error in db walk read 'type'
05/08/2025 00:57:50.705 7fa823494c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:50.705 7fa823494c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.56:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Zookeeper:Zookeeper[] connection down  >>,  ]  >>  
05/08/2025 00:57:50.705 7fa823494c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:50.716 7fa823494c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:50.716 7fa823494c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.56:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:57:50.716 7fa823494c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:50.716 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_status_consumer.dummy
05/08/2025 00:57:50.716 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_request_consumer
05/08/2025 00:57:50.717 7fa82903b6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection
05/08/2025 00:57:50.717 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3284-2.
05/08/2025 00:57:50.720 7fa82903b6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established <Connection: amqp://guest:**@10.0.0.56:5673// at 0x7fa82359d438>
05/08/2025 00:57:50.809 7fa82903b6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3284-2.']
05/08/2025 00:57:50.837 7fa82903b6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection
05/08/2025 00:57:50.847 7fa82903b6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established <Connection: amqp://guest:**@10.0.0.56:5673// at 0x7fa82359d438>
05/08/2025 00:57:50.871 7fa82903b6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3284-2.']
05/08/2025 00:57:51.228 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Fetching all containers
05/08/2025 00:57:51.265 7fa82c0d2c88 [contrail-device-manager] [INFO]: Restarting dnsmasq docker: config_dnsmasq_1
05/08/2025 00:57:51.457 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3284-2..config_queue
05/08/2025 00:57:51.457 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3284-2..tftp_queue
05/08/2025 00:57:51.896 7fa82903b6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection
05/08/2025 00:57:51.900 7fa82903b6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established <Connection: amqp://guest:**@10.0.0.56:5673// at 0x7fa82359d438>
05/08/2025 00:57:51.958 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Process 138 prepared to run in Full mode...
05/08/2025 00:57:51.958 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Elected master Device Manager node. Initializing... 
05/08/2025 00:57:51.958 7fa82c0d2c88 [contrail-device-manager] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8096
05/08/2025 00:57:51.961 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add [config_updater.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/config_updater] to home page
05/08/2025 00:57:51.961 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_ConfigApiUpdateReq]
05/08/2025 00:57:51.962 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add [greenlets.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/greenlets] to home page
05/08/2025 00:57:51.962 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_GreenletObjectReq]
05/08/2025 00:57:51.963 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add [cpuinfo.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/nodeinfo/cpuinfo] to home page
05/08/2025 00:57:51.963 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CpuLoadInfoReq]
05/08/2025 00:57:51.966 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add [dm_introspect.xml:/usr/lib/python3.6/site-packages/device_manager/sandesh/dm_introspect] to home page
05/08/2025 00:57:51.966 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_RoutingInstanceList]
05/08/2025 00:57:51.966 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualNetworkList]
05/08/2025 00:57:51.966 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualMachineInterfaceList]
05/08/2025 00:57:51.966 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalInterfaceList]
05/08/2025 00:57:51.966 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalInterfaceList]
05/08/2025 00:57:51.967 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalRouterList]
05/08/2025 00:57:51.967 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_BgpRouterList]
05/08/2025 00:57:51.967 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalRouterList]
05/08/2025 00:57:51.967 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_InstanceIpList]
05/08/2025 00:57:51.967 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FloatingIpList]
05/08/2025 00:57:51.967 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PortTupleList]
05/08/2025 00:57:51.967 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FeatureFlagList]
05/08/2025 00:57:51.968 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add [sandesh_alarm.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_alarm] to home page
05/08/2025 00:57:51.968 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmCacheRequest]
05/08/2025 00:57:51.968 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmTypesRequest]
05/08/2025 00:57:51.968 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmAckRequest]
05/08/2025 00:57:51.969 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add [sandesh_ctrl.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_ctrl] to home page
05/08/2025 00:57:51.969 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlClientToServer]
05/08/2025 00:57:51.969 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlServerToClient]
05/08/2025 00:57:51.969 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add [sandesh_trace.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_trace] to home page
05/08/2025 00:57:51.969 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceRequest]
05/08/2025 00:57:51.969 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferListRequest]
05/08/2025 00:57:51.970 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceEnableDisableReq]
05/08/2025 00:57:51.970 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufStatusReq]
05/08/2025 00:57:51.970 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferEnableDisableReq]
05/08/2025 00:57:51.970 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add [sandesh_uve.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_uve] to home page
05/08/2025 00:57:51.970 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshMessageStatsReq]
05/08/2025 00:57:51.971 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsSet]
05/08/2025 00:57:51.971 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsStatus]
05/08/2025 00:57:51.971 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsSet]
05/08/2025 00:57:51.971 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsStatus]
05/08/2025 00:57:51.971 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsSet]
05/08/2025 00:57:51.971 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsReset]
05/08/2025 00:57:51.971 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsStatus]
05/08/2025 00:57:51.971 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueSet]
05/08/2025 00:57:51.971 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueStatus]
05/08/2025 00:57:51.971 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CollectorInfoRequest]
05/08/2025 00:57:51.971 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVEDSConfReq]
05/08/2025 00:57:51.971 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVECacheReq]
05/08/2025 00:57:51.972 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVETypesReq]
05/08/2025 00:57:51.974 7fa82c0d2c88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.ztp_queue
05/08/2025 00:57:51.986 7fa822bc7828 [contrail-device-manager] [ERROR]: Cannot write http_port 8096 to /tmp/contrail-device-manager.1.http_port
05/08/2025 00:57:51.986 7fa822bc7828 [contrail-device-manager] [ERROR]: Starting Introspect on HTTP Port 8096
05/08/2025 00:57:52.029 7fa8223948d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:52.029 7fa8223948d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.56:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Initializing  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down  >>,  ]  >>  
05/08/2025 00:57:52.029 7fa8223948d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:52.040 7fa8222f1e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:52.040 7fa8222f1e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.56:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Down  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down  >>,  ]  >>  
05/08/2025 00:57:52.040 7fa8222f1e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:52.106 7fa82903b6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3284-2.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3284-2..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3284-2..tftp_queue', 'device_manager_ztp.ztp_queue']
05/08/2025 00:57:52.132 7fa82903b6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection
05/08/2025 00:57:52.136 7fa82903b6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established <Connection: amqp://guest:**@10.0.0.56:5673// at 0x7fa82359d438>
05/08/2025 00:57:52.170 7fa82903b6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3284-2.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3284-2..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3284-2..tftp_queue', 'device_manager_ztp.ztp_queue']
05/08/2025 00:57:54.060 7fa8222874e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:57:54.061 7fa8222874e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:57:54.061 7fa8222874e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:57:54.061 7fa8222874e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:57:54.061 7fa8222874e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.33:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Down  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down  >>,  ]  >>  
05/08/2025 00:57:54.062 7fa8222874e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:57:54.062 7fa8222874e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:57:54.062 7fa8222874e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:57:54.062 7fa8222874e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:54.062 7fa8222874e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.33:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Down  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down  >>,  ]  >>  
05/08/2025 00:57:54.062 7fa8222874e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:54.062 7fa8222874e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:54.062 7fa8222874e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.33:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:57:54.062 7fa8222874e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:58.066 7fa8221e5048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:57:58.068 7fa8221e5048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:57:58.068 7fa8221e5048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:57:58.069 7fa8221e5048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:57:58.069 7fa8221e5048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Down  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down  >>,  ]  >>  
05/08/2025 00:57:58.069 7fa8221e5048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:57:58.069 7fa8221e5048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:57:58.069 7fa8221e5048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:57:58.069 7fa8221e5048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:58.069 7fa8221e5048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Down  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down  >>,  ]  >>  
05/08/2025 00:57:58.069 7fa8221e5048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:58.069 7fa8221e5048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:58.070 7fa8221e5048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.249:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:57:58.070 7fa8221e5048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:58.164 7fa822222eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:57:58.164 7fa822222eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:57:58.164 7fa822222eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:02.069 7fa822147438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:58:02.070 7fa822147438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:58:02.070 7fa822147438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:58:02.070 7fa822147438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:58:02.070 7fa822147438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.56:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
05/08/2025 00:58:02.070 7fa822147438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:58:02.070 7fa822147438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:58:02.070 7fa822147438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:58:02.070 7fa822147438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:02.071 7fa822147438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.56:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:58:02.071 7fa822147438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:02.071 7fa822147438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:02.071 7fa822147438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.56:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:58:02.071 7fa822147438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:06.071 7fa8222ed630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:58:06.088 7fa8222ed630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:58:06.088 7fa8222ed630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:58:06.088 7fa8222ed630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:58:06.088 7fa8222ed630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.33:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
05/08/2025 00:58:06.088 7fa8222ed630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:58:06.088 7fa8222ed630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:58:06.089 7fa8222ed630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:58:06.089 7fa8222ed630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:06.089 7fa8222ed630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.33:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:58:06.089 7fa8222ed630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:06.089 7fa8222ed630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:06.089 7fa8222ed630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.33:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:58:06.089 7fa8222ed630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:10.089 7fa8235d0438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:58:10.090 7fa8235d0438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:58:10.090 7fa8235d0438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:58:10.090 7fa8235d0438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:58:10.090 7fa8235d0438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
05/08/2025 00:58:10.090 7fa8235d0438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:58:10.090 7fa8235d0438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:58:10.091 7fa8235d0438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:58:10.091 7fa8235d0438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:10.091 7fa8235d0438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:58:10.091 7fa8235d0438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:10.091 7fa8235d0438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:10.091 7fa8235d0438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.249:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:58:10.091 7fa8235d0438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:14.092 7fa8235d0438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:58:14.093 7fa8235d0438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:58:14.093 7fa8235d0438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:58:14.093 7fa8235d0438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:58:14.093 7fa8235d0438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.56:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
05/08/2025 00:58:14.093 7fa8235d0438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:58:14.093 7fa8235d0438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:58:14.094 7fa8235d0438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:58:14.094 7fa8235d0438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:14.094 7fa8235d0438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.56:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:58:14.094 7fa8235d0438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:14.094 7fa8235d0438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:14.094 7fa8235d0438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.56:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:58:14.094 7fa8235d0438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:18.094 7fa8221e5978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:58:18.095 7fa8221e5978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:58:18.095 7fa8221e5978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:58:18.095 7fa8221e5978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:58:18.095 7fa8221e5978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.33:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
05/08/2025 00:58:18.095 7fa8221e5978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:58:18.095 7fa8221e5978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:58:18.096 7fa8221e5978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:58:18.096 7fa8221e5978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:18.096 7fa8221e5978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.33:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:58:18.096 7fa8221e5978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:18.096 7fa8221e5978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:18.096 7fa8221e5978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.33:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:58:18.096 7fa8221e5978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:22.096 7fa823566eb8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:58:22.097 7fa823566eb8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:58:22.097 7fa823566eb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:58:22.097 7fa823566eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:58:22.097 7fa823566eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
05/08/2025 00:58:22.097 7fa823566eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:58:22.097 7fa823566eb8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:58:22.097 7fa823566eb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:58:22.098 7fa823566eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:22.098 7fa823566eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:58:22.098 7fa823566eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:22.098 7fa823566eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:22.098 7fa823566eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.249:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:58:22.098 7fa823566eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:26.098 7fa8234f1f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:58:26.099 7fa8234f1f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:58:26.099 7fa8234f1f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:58:26.099 7fa8234f1f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:58:26.099 7fa8234f1f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.56:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
05/08/2025 00:58:26.099 7fa8234f1f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:58:26.099 7fa8234f1f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:58:26.100 7fa8234f1f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:58:26.100 7fa8234f1f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:26.100 7fa8234f1f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.56:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:58:26.100 7fa8234f1f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:26.100 7fa8234f1f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:26.100 7fa8234f1f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.56:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:58:26.100 7fa8234f1f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:30.100 7fa8234f1f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:58:30.101 7fa8234f1f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:58:30.101 7fa8234f1f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:58:30.101 7fa8234f1f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:58:30.101 7fa8234f1f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.33:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
05/08/2025 00:58:30.101 7fa8234f1f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:58:30.101 7fa8234f1f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:58:30.101 7fa8234f1f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:58:30.101 7fa8234f1f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:30.102 7fa8234f1f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.33:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:58:30.102 7fa8234f1f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:30.102 7fa8234f1f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:30.102 7fa8234f1f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.33:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:58:30.102 7fa8234f1f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:34.102 7fa8221df978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:58:34.103 7fa8221df978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:58:34.103 7fa8221df978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:58:34.103 7fa8221df978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:58:34.103 7fa8221df978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
05/08/2025 00:58:34.103 7fa8221df978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:58:34.104 7fa8221df978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:58:34.104 7fa8221df978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:58:34.104 7fa8221df978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:34.104 7fa8221df978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:58:34.104 7fa8221df978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:34.104 7fa8221df978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:34.104 7fa8221df978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.249:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:58:34.104 7fa8221df978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:38.104 7fa8234b78d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:58:38.107 7fa8234b78d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:58:38.107 7fa8234b78d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:58:38.107 7fa8234b78d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:58:38.107 7fa8234b78d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.56:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
05/08/2025 00:58:38.107 7fa8234b78d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:58:38.107 7fa8234b78d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:58:38.107 7fa8234b78d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:58:38.107 7fa8234b78d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:38.107 7fa8234b78d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.56:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:58:38.108 7fa8234b78d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:38.108 7fa8234b78d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:38.108 7fa8234b78d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.56:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:58:38.108 7fa8234b78d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:42.109 7fa823703198 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:58:42.110 7fa823703198 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:58:42.110 7fa823703198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:58:42.110 7fa823703198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:58:42.110 7fa823703198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.33:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
05/08/2025 00:58:42.110 7fa823703198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:58:42.110 7fa823703198 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:58:42.110 7fa823703198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:58:42.110 7fa823703198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:42.111 7fa823703198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.33:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:58:42.111 7fa823703198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:42.111 7fa823703198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:42.111 7fa823703198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.33:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:58:42.111 7fa823703198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:46.111 7fa826f73eb8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:58:46.112 7fa826f73eb8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:58:46.112 7fa826f73eb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:58:46.112 7fa826f73eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:58:46.112 7fa826f73eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
05/08/2025 00:58:46.112 7fa826f73eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:58:46.113 7fa826f73eb8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:58:46.113 7fa826f73eb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:58:46.113 7fa826f73eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:46.113 7fa826f73eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:58:46.113 7fa826f73eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:46.113 7fa826f73eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:46.113 7fa826f73eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.249:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:58:46.113 7fa826f73eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:47.874 7fa82c0d2c88 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql
05/08/2025 00:58:47.874 7fa82c0d2c88 [contrail-device-manager] [WARNING]: initializing cassandra cluster
05/08/2025 00:58:47.874 7fa82c0d2c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create
05/08/2025 00:58:47.875 7fa82a440d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:47.875 7fa82a440d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
05/08/2025 00:58:47.875 7fa82a440d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:47.876 7fa82c0d2c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created
05/08/2025 00:58:47.907 7fa82c0d2c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected
05/08/2025 00:58:47.909 7fa82216f4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:47.909 7fa82216f4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Initializing  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[], Zookeeper:Zookeeper[] connection down  >>,  ]  >>  
05/08/2025 00:58:47.909 7fa82216f4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:47.918 7fa82c0d2c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS
05/08/2025 00:58:47.918 7fa82216f2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:47.918 7fa82216f2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
05/08/2025 00:58:47.918 7fa82216f2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:47.931 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
05/08/2025 00:58:48.604 7fa82c0d2c88 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace', created
05/08/2025 00:58:48.609 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
05/08/2025 00:58:48.616 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
05/08/2025 00:58:49.286 7fa82c0d2c88 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None}
05/08/2025 00:58:49.290 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
05/08/2025 00:58:49.290 7fa82c0d2c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready
05/08/2025 00:58:49.356 7fa82c0d2c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready
05/08/2025 00:58:49.363 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
05/08/2025 00:58:50.113 7fa8220e5630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:58:50.114 7fa8220e5630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:58:50.114 7fa8220e5630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:58:50.114 7fa8220e5630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:58:50.115 7fa8220e5630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.56:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
05/08/2025 00:58:50.115 7fa8220e5630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:58:50.115 7fa8220e5630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:58:50.115 7fa8220e5630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:58:50.115 7fa8220e5630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:50.115 7fa8220e5630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.56:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
05/08/2025 00:58:50.115 7fa8220e5630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:50.115 7fa8220e5630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:50.115 7fa8220e5630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.56:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:58:50.115 7fa8220e5630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:50.738 7fa82c0d2c88 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table', created
05/08/2025 00:58:50.743 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
05/08/2025 00:58:50.749 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
05/08/2025 00:58:51.861 7fa82c0d2c88 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table' fixed with properties {'gc_grace_seconds': 864000}
05/08/2025 00:58:51.865 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
05/08/2025 00:58:51.871 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
05/08/2025 00:58:52.801 7fa82c0d2c88 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table', created
05/08/2025 00:58:52.806 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
05/08/2025 00:58:52.834 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
05/08/2025 00:58:53.717 7fa82c0d2c88 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table' fixed with properties {'gc_grace_seconds': 864000}
05/08/2025 00:58:53.722 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
05/08/2025 00:58:53.727 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
05/08/2025 00:58:54.115 7fa822080240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:58:54.116 7fa822080240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:58:54.116 7fa822080240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:58:54.116 7fa822080240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:58:54.116 7fa822080240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.33:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
05/08/2025 00:58:54.116 7fa822080240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:58:54.116 7fa822080240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:58:54.116 7fa822080240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:58:54.116 7fa822080240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:54.117 7fa822080240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.33:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
05/08/2025 00:58:54.117 7fa822080240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:54.117 7fa822080240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:54.117 7fa822080240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.33:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:58:54.117 7fa822080240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:54.291 7fa82c0d2c88 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table', created
05/08/2025 00:58:54.296 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
05/08/2025 00:58:54.301 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
05/08/2025 00:58:55.374 7fa82c0d2c88 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table' fixed with properties {'gc_grace_seconds': 864000}
05/08/2025 00:58:55.378 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
05/08/2025 00:58:55.386 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
05/08/2025 00:58:55.901 7fa82c0d2c88 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table', created
05/08/2025 00:58:55.908 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
05/08/2025 00:58:55.916 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
05/08/2025 00:58:56.678 7fa82c0d2c88 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table' fixed with properties {'gc_grace_seconds': 864000}
05/08/2025 00:58:56.683 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
05/08/2025 00:58:56.684 7fa8221ea0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:56.684 7fa8221ea0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.33:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:58:56.684 7fa8221ea0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:56.727 7fa82c0d2c88 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.56:5673//', 'pyamqp://guest:guest@10.0.0.33:5673//', 'pyamqp://guest:guest@10.0.0.249:5673//']
05/08/2025 00:58:56.728 7fa82c0d2c88 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down
05/08/2025 00:58:56.728 7fa822086f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:56.728 7fa822086f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.33:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Initializing  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down  >>,  ]  >>  
05/08/2025 00:58:56.729 7fa822086f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:56.729 7fa822086f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:56.729 7fa822086f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.33:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Down  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down  >>,  ]  >>  
05/08/2025 00:58:56.729 7fa822086f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:56.732 7fa82c0d2c88 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.56:5673// at 0x7fa8235a0dd8>
05/08/2025 00:58:56.733 7fa822086978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:56.733 7fa822086978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.33:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:58:56.733 7fa822086978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:56.776 7fa82c0d2c88 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down
05/08/2025 00:58:56.777 7fa822086978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:56.777 7fa822086978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.33:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Down  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down  >>,  ]  >>  
05/08/2025 00:58:56.777 7fa822086978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:56.780 7fa82c0d2c88 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.56:5673// at 0x7fa822043320>
05/08/2025 00:58:56.781 7fa822080828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:56.781 7fa822080828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.33:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:58:56.781 7fa822080828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:56.782 7fa822080438 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down
05/08/2025 00:58:56.782 7fa8220f0048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:56.782 7fa8220f0048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.33:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Down  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down  >>,  ]  >>  
05/08/2025 00:58:56.782 7fa8220f0048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:56.795 7fa822080438 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.56:5673// at 0x7fa822043320>
05/08/2025 00:58:56.796 7fa8222f6780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:56.796 7fa8222f6780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.33:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:58:56.796 7fa8222f6780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:57.061 7fa822080588 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain',
             'default-project',
             'ip-fabric',
             '__default__',
             'cn-jenkins-deploy-platform-ansible-os-3284-1'],
 'oper': 'UPDATE',
 'request-id': 'req-dc20006d-6863-4ec8-aba6-fa4eac3a8a9a',
 'type': 'bgp_router',
 'uuid': '1085eef5-4d24-42eb-8b05-8a300d9f0612'}
05/08/2025 00:58:57.064 7fa822080588 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain',
             'default-project',
             'ip-fabric',
             '__default__',
             'cn-jenkins-deploy-platform-ansible-os-3284-2'],
 'oper': 'UPDATE-IMPLICIT',
 'request-id': 'req-dc20006d-6863-4ec8-aba6-fa4eac3a8a9a',
 'type': 'bgp_router',
 'uuid': 'f4029cac-8efc-4f5e-8fc3-3bed879e4351'}
05/08/2025 00:58:57.595 7fa822080588 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'],
 'oper': 'UPDATE',
 'request-id': 'req-2477ad0f-313e-4ff0-b1d8-8deeefd1c551',
 'type': 'global_system_config',
 'uuid': '8ebb224d-162d-466a-bdf6-32a738db0a8b'}
05/08/2025 00:58:57.650 7fa822080588 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'],
 'oper': 'UPDATE',
 'request-id': 'req-b4617c82-0528-421a-a7a2-7fba0d9f7026',
 'type': 'global_vrouter_config',
 'uuid': '1be2be3e-0a09-4cdf-b743-789400e83989'}
05/08/2025 00:58:57.683 7fa822080588 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'],
 'oper': 'UPDATE',
 'request-id': 'req-e20c8b15-ed56-48ec-a19e-e6e464a712d2',
 'type': 'global_vrouter_config',
 'uuid': '1be2be3e-0a09-4cdf-b743-789400e83989'}
05/08/2025 00:58:58.117 7fa8220f2d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:58:58.118 7fa8220f2d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:58:58.118 7fa8220f2d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:58:58.118 7fa8220f2d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:58:58.118 7fa8220f2d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
05/08/2025 00:58:58.118 7fa8220f2d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:58:58.118 7fa8220f2d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:58:58.119 7fa8220f2d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:58:58.119 7fa8220f2d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:58.119 7fa8220f2d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:58:58.119 7fa8220f2d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:58.119 7fa8220f2d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:58.119 7fa8220f2d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.249:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:58:58.119 7fa8220f2d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:58:58.758 7fa822080588 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'],
 'oper': 'UPDATE',
 'request-id': 'req-90143ff4-787a-4945-b118-6cdc1c5f3cd0',
 'type': 'global_system_config',
 'uuid': '8ebb224d-162d-466a-bdf6-32a738db0a8b'}
05/08/2025 00:58:58.820 7fa822080588 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'],
 'oper': 'UPDATE',
 'request-id': 'req-1ea15195-8c0a-4671-82b6-fec747595b5f',
 'type': 'global_system_config',
 'uuid': '8ebb224d-162d-466a-bdf6-32a738db0a8b'}
05/08/2025 00:59:02.119 7fa8220f0a20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:59:02.120 7fa8220f0a20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:59:02.120 7fa8220f0a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:59:02.120 7fa8220f0a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:59:02.120 7fa8220f0a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.56:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
05/08/2025 00:59:02.120 7fa8220f0a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:59:02.120 7fa8220f0a20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:59:02.121 7fa8220f0a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:59:02.121 7fa8220f0a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:02.121 7fa8220f0a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.56:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:59:02.121 7fa8220f0a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:02.121 7fa8220f0a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:02.121 7fa8220f0a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.56:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:59:02.121 7fa8220f0a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:06.121 7fa8220f0a20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:59:06.122 7fa8220f0a20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:59:06.122 7fa8220f0a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:59:06.122 7fa8220f0a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:59:06.122 7fa8220f0a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.33:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
05/08/2025 00:59:06.122 7fa8220f0a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:59:06.122 7fa8220f0a20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:59:06.123 7fa8220f0a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:59:06.123 7fa8220f0a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:06.123 7fa8220f0a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.33:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:59:06.123 7fa8220f0a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:06.123 7fa8220f0a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:06.123 7fa8220f0a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.33:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:59:06.123 7fa8220f0a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:10.123 7fa82349f978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:59:10.124 7fa82349f978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:59:10.124 7fa82349f978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:59:10.124 7fa82349f978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:59:10.124 7fa82349f978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
05/08/2025 00:59:10.124 7fa82349f978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:59:10.124 7fa82349f978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:59:10.124 7fa82349f978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:59:10.124 7fa82349f978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:10.125 7fa82349f978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:59:10.125 7fa82349f978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:10.125 7fa82349f978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:10.125 7fa82349f978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.249:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:59:10.125 7fa82349f978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:14.125 7fa82349f978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:59:14.126 7fa82349f978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:59:14.126 7fa82349f978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:59:14.126 7fa82349f978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:59:14.126 7fa82349f978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.56:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
05/08/2025 00:59:14.126 7fa82349f978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:59:14.126 7fa82349f978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:59:14.127 7fa82349f978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:59:14.127 7fa82349f978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:14.127 7fa82349f978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.56:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:59:14.127 7fa82349f978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:14.127 7fa82349f978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:14.127 7fa82349f978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.56:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:59:14.127 7fa82349f978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:18.126 7fa82349f978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:59:18.127 7fa82349f978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:59:18.127 7fa82349f978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:59:18.127 7fa82349f978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:59:18.128 7fa82349f978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.33:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
05/08/2025 00:59:18.128 7fa82349f978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:59:18.128 7fa82349f978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:59:18.128 7fa82349f978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:59:18.128 7fa82349f978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:18.128 7fa82349f978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.33:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:59:18.128 7fa82349f978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:18.128 7fa82349f978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:18.128 7fa82349f978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.33:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:59:18.128 7fa82349f978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:22.129 7fa82349f978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:59:22.130 7fa82349f978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:59:22.130 7fa82349f978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:59:22.130 7fa82349f978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:59:22.130 7fa82349f978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
05/08/2025 00:59:22.130 7fa82349f978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:59:22.130 7fa82349f978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:59:22.131 7fa82349f978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:59:22.131 7fa82349f978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:22.131 7fa82349f978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:59:22.131 7fa82349f978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:22.131 7fa82349f978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:22.131 7fa82349f978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.249:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:59:22.131 7fa82349f978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:23.539 7fa822080588 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3284-2.'],
 'obj_dict': {'database_node_ip_address': '10.0.0.33',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3284-2.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3284-2.'],
              'id_perms': {'created': '2025-05-08T00:59:23.527519',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-05-08T00:59:23.527519',
                           'permissions': {'group': 'reader',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 12627705082645574760,
                                    'uuid_mslong': 12517537478695864934}},
              'parent_type': 'global-system-config',
              'parent_uuid': '8ebb224d-162d-466a-bdf6-32a738db0a8b',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'adb73a04-204e-4a66-af3e-9ede437bf468'},
 'oper': 'CREATE',
 'request-id': 'req-2632b708-6a53-45b3-8a91-7f3e078a2b2f',
 'type': 'database_node',
 'uuid': 'adb73a04-204e-4a66-af3e-9ede437bf468'}
05/08/2025 00:59:24.176 7fa822080588 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3284-3.'],
 'obj_dict': {'database_node_ip_address': '10.0.0.249',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3284-3.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3284-3.'],
              'id_perms': {'created': '2025-05-08T00:59:24.163523',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-05-08T00:59:24.163523',
                           'permissions': {'group': 'reader',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 11691984407120636131,
                                    'uuid_mslong': 8333465597929408880}},
              'parent_type': 'global-system-config',
              'parent_uuid': '8ebb224d-162d-466a-bdf6-32a738db0a8b',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '73a66acf-0885-4970-a242-45df19d4e8e3'},
 'oper': 'CREATE',
 'request-id': 'req-9d548112-14ff-443a-a2fe-6609f11d383f',
 'type': 'database_node',
 'uuid': '73a66acf-0885-4970-a242-45df19d4e8e3'}
05/08/2025 00:59:24.290 7fa822080588 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3284-1.'],
 'obj_dict': {'database_node_ip_address': '10.0.0.56',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3284-1.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3284-1.'],
              'id_perms': {'created': '2025-05-08T00:59:24.274399',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-05-08T00:59:24.274399',
                           'permissions': {'group': 'reader',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 10746149741476044473,
                                    'uuid_mslong': 20774925023333006}},
              'parent_type': 'global-system-config',
              'parent_uuid': '8ebb224d-162d-466a-bdf6-32a738db0a8b',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '0049ceaf-2a40-4a8e-9521-fe411bd5deb9'},
 'oper': 'CREATE',
 'request-id': 'req-a58536af-9122-491f-8db4-9702268b52f9',
 'type': 'database_node',
 'uuid': '0049ceaf-2a40-4a8e-9521-fe411bd5deb9'}
05/08/2025 00:59:26.132 7fa8220f06d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:59:26.133 7fa8220f06d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:59:26.133 7fa8220f06d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:59:26.133 7fa8220f06d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:59:26.133 7fa8220f06d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.56:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
05/08/2025 00:59:26.134 7fa8220f06d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:59:26.134 7fa8220f06d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:59:26.134 7fa8220f06d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:59:26.134 7fa8220f06d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:26.134 7fa8220f06d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.56:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:59:26.134 7fa8220f06d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:26.134 7fa8220f06d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:26.134 7fa8220f06d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.56:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:59:26.134 7fa8220f06d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:30.135 7fa8220f06d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:59:30.136 7fa8220f06d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:59:30.136 7fa8220f06d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:59:30.136 7fa8220f06d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:59:30.136 7fa8220f06d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.33:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
05/08/2025 00:59:30.136 7fa8220f06d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:59:30.136 7fa8220f06d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:59:30.137 7fa8220f06d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:59:30.137 7fa8220f06d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:30.137 7fa8220f06d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.33:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:59:30.137 7fa8220f06d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:30.137 7fa8220f06d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:30.137 7fa8220f06d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.33:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:59:30.137 7fa8220f06d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:34.137 7fa8220f0978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:59:34.138 7fa8220f0978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:59:34.138 7fa8220f0978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:59:34.138 7fa8220f0978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:59:34.138 7fa8220f0978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
05/08/2025 00:59:34.138 7fa8220f0978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:59:34.138 7fa8220f0978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:59:34.139 7fa8220f0978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:59:34.139 7fa8220f0978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:34.139 7fa8220f0978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:59:34.139 7fa8220f0978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:34.139 7fa8220f0978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:34.139 7fa8220f0978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.249:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:59:34.139 7fa8220f0978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:38.139 7fa8220f0978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:59:38.140 7fa8220f0978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:59:38.141 7fa8220f0978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:59:38.141 7fa8220f0978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:59:38.141 7fa8220f0978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.56:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
05/08/2025 00:59:38.141 7fa8220f0978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:59:38.141 7fa8220f0978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:59:38.141 7fa8220f0978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:59:38.141 7fa8220f0978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:38.141 7fa8220f0978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.56:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:59:38.141 7fa8220f0978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:38.141 7fa8220f0978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:38.142 7fa8220f0978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.56:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:59:38.142 7fa8220f0978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:42.141 7fa82349f4e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:59:42.142 7fa82349f4e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:59:42.142 7fa82349f4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:59:42.142 7fa82349f4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:59:42.143 7fa82349f4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.33:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
05/08/2025 00:59:42.143 7fa82349f4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:59:42.143 7fa82349f4e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:59:42.143 7fa82349f4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:59:42.143 7fa82349f4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:42.143 7fa82349f4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.33:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:59:42.143 7fa82349f4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:42.143 7fa82349f4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:42.143 7fa82349f4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.33:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:59:42.143 7fa82349f4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:46.143 7fa82349f4e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:59:46.144 7fa82349f4e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:59:46.144 7fa82349f4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:59:46.145 7fa82349f4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:59:46.145 7fa82349f4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
05/08/2025 00:59:46.145 7fa82349f4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:59:46.145 7fa82349f4e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:59:46.145 7fa82349f4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:59:46.145 7fa82349f4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:46.145 7fa82349f4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:59:46.145 7fa82349f4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:46.145 7fa82349f4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:46.146 7fa82349f4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.249:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:59:46.146 7fa82349f4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:50.145 7fa8220f2c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:59:50.147 7fa8220f2c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
05/08/2025 00:59:50.147 7fa8220f2c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:59:50.147 7fa8220f2c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:59:50.147 7fa8220f2c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.56:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
05/08/2025 00:59:50.147 7fa8220f2c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:59:50.147 7fa8220f2c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
05/08/2025 00:59:50.147 7fa8220f2c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
05/08/2025 00:59:50.148 7fa8220f2c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:50.148 7fa8220f2c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.56:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
05/08/2025 00:59:50.148 7fa8220f2c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:50.148 7fa8220f2c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:50.148 7fa8220f2c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1746665858053223  collector_name =   collector_ip = 10.0.0.56:8086  collector_list = [ 10.0.0.33:8086, 10.0.0.249:8086, 10.0.0.56:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
05/08/2025 00:59:50.148 7fa8220f2c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
05/08/2025 00:59:52.640 7fa822080588 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3284-2.'],
 'obj_dict': {'analytics_node_ip_address': '10.0.0.33',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3284-2.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3284-2.'],
              'id_perms': {'created': '2025-05-08T00:59:52.631905',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-05-08T00:59:52.631905',
                           'permissions': {'group': 'reader',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 9973744623861325156,
                                    'uuid_mslong': 5272631509251671694}},
              'parent_type': 'global-system-config',
              'parent_uuid': '8ebb224d-162d-466a-bdf6-32a738db0a8b',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '492c266c-0c7a-468e-8a69-dbe469b75d64'},
 'oper': 'CREATE',
 'request-id': 'req-a9d321dc-efa4-4ea6-ac9d-0fdd38870376',
 'type': 'analytics_node',
 'uuid': '492c266c-0c7a-468e-8a69-dbe469b75d64'}
05/08/2025 00:59:53.118 7fa822080588 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3284-3.'],
 'obj_dict': {'analytics_node_ip_address': '10.0.0.249',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3284-3.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3284-3.'],
              'id_perms': {'created': '2025-05-08T00:59:53.104304',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-05-08T00:59:53.104304',
                           'permissions': {'group': 'reader',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 12547713770249534953,
                                    'uuid_mslong': 5792009500951462066}},
              'parent_type': 'global-system-config',
              'parent_uuid': '8ebb224d-162d-466a-bdf6-32a738db0a8b',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '506159f4-27e6-40b2-ae22-6f3183003de9'},
 'oper': 'CREATE',
 'request-id': 'req-322a49d8-1217-4549-842c-bf757c8c0f7b',
 'type': 'analytics_node',
 'uuid': '506159f4-27e6-40b2-ae22-6f3183003de9'}
05/08/2025 00:59:53.155 7fa822080588 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3284-1.'],
 'obj_dict': {'analytics_node_ip_address': '10.0.0.56',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3284-1.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3284-1.'],
              'id_perms': {'created': '2025-05-08T00:59:53.146523',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-05-08T00:59:53.146523',
                           'permissions': {'group': 'reader',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 9815217087866809699,
                                    'uuid_mslong': 14277631037657335566}},
              'parent_type': 'global-system-config',
              'parent_uuid': '8ebb224d-162d-466a-bdf6-32a738db0a8b',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'c62455c8-59a8-470e-8836-a7f02ba52d63'},
 'oper': 'CREATE',
 'request-id': 'req-51089128-ef7f-4b5c-84ea-07b5244acbb1',
 'type': 'analytics_node',
 'uuid': 'c62455c8-59a8-470e-8836-a7f02ba52d63'}
05/08/2025 00:59:54.148 7fa8220f2c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
05/08/2025 00:59:54.149 7fa8220f2c18 [contrail-device-manager] [INFO]: Session Event: TCP Connected
05/08/2025 00:59:54.150 7fa8220f2c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
05/08/2025 00:59:54.150 7fa8220f2c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:59:54.150 7fa8220f2c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3284-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.33:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.56:5673, 10.0.0.33:5673, 10.0.0.249:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.56:9041, 10.0.0.33:9041, 10.0.0.249:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.56:2181, 10.0.0.33:2181, 10.0.0.249:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.56,10.0.0.33,10.0.0.249:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
05/08/2025 00:59:54.150 7fa8220f2c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
05/08/2025 00:59:54.150 7fa8220f2c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnected] in state[Connect]
05/08/2025 00:59:54.150 7fa8220f2c18 [contrail-device-manager] [DEBUG]: Send sandesh control message. uve type count # 19
05/08/2025 00:59:54.151 7fa8220f2c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit]
05/08/2025 00:59:54.151 7fa8220f2c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit]
05/08/2025 00:59:54.151 7fa8220f2c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit]
05/08/2025 00:59:54.152 7fa823566ac8 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG]
05/08/2025 00:59:54.153 7fa823566ac8 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID]
05/08/2025 01:00:03.476 7fa822089eb8 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001016
05/08/2025 01:00:03.477 7fa822089eb8 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient]
05/08/2025 01:00:03.477 7fa8220c16d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit]
05/08/2025 01:00:03.477 7fa8220c16d8 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 0
05/08/2025 01:00:03.478 7fa8220c16d8 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3284-2.: 94> in the [ObjectConfigNode:NodeStatusUVE] map
05/08/2025 01:00:03.478 7fa8220c16d8 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0: 35> in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map
05/08/2025 01:00:03.478 7fa8220c16d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established]
05/08/2025 01:00:03.478 7fa8220f0630 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG]
05/08/2025 01:00:03.479 7fa8220f0630 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID]
05/08/2025 01:00:09.713 7fa822080588 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3284-3.'],
 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.249',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3284-3.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3284-3.'],
              'id_perms': {'created': '2025-05-08T01:00:09.700158',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-05-08T01:00:09.700158',
                           'permissions': {'group': 'reader',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 13735888653787988053,
                                    'uuid_mslong': 13153515298602567679}},
              'parent_type': 'global-system-config',
              'parent_uuid': '8ebb224d-162d-466a-bdf6-32a738db0a8b',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'b68aac79-48df-47ff-be9f-adf46b5a0055'},
 'oper': 'CREATE',
 'request-id': 'req-f834e07c-975e-4fbc-964b-19778139aadd',
 'type': 'analytics_alarm_node',
 'uuid': 'b68aac79-48df-47ff-be9f-adf46b5a0055'}
05/08/2025 01:00:09.782 7fa822080588 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3284-2.'],
 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.33',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3284-2.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3284-2.'],
              'id_perms': {'created': '2025-05-08T01:00:09.754255',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-05-08T01:00:09.754255',
                           'permissions': {'group': 'reader',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 10707923971881995142,
                                    'uuid_mslong': 15632708793725635081}},
              'parent_type': 'global-system-config',
              'parent_uuid': '8ebb224d-162d-466a-bdf6-32a738db0a8b',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'd8f289d2-7f24-4a09-949a-301e91ea8b86'},
 'oper': 'CREATE',
 'request-id': 'req-00008bae-9d00-4c41-8341-7b2d5c3711f1',
 'type': 'analytics_alarm_node',
 'uuid': 'd8f289d2-7f24-4a09-949a-301e91ea8b86'}
05/08/2025 01:00:09.820 7fa822080588 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3284-1.'],
 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.56',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3284-1.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3284-1.'],
              'id_perms': {'created': '2025-05-08T01:00:09.806493',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-05-08T01:00:09.806493',
                           'permissions': {'group': 'reader',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 12085778147558433737,
                                    'uuid_mslong': 11353642796669944104}},
              'parent_type': 'global-system-config',
              'parent_uuid': '8ebb224d-162d-466a-bdf6-32a738db0a8b',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '9d903df8-2a2f-4128-a7b9-4f31276623c9'},
 'oper': 'CREATE',
 'request-id': 'req-d45f9e90-8d9f-4df9-b740-ca228fb827d2',
 'type': 'analytics_alarm_node',
 'uuid': '9d903df8-2a2f-4128-a7b9-4f31276623c9'}
05/08/2025 01:00:14.169 7fa822089eb8 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001296
05/08/2025 01:00:14.169 7fa822089eb8 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient]
05/08/2025 01:00:14.170 7fa823828240 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established]
05/08/2025 01:00:14.170 7fa823828240 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 2
05/08/2025 01:00:14.170 7fa823828240 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3284-2.: 95> in the [ObjectConfigNode:NodeStatusUVE] map
05/08/2025 01:00:14.170 7fa823828240 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3284-2.:Config:contrail-device-manager:0: 36> in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map
05/08/2025 01:00:19.807 7fa822080588 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3284-2.'],
 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.33',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3284-2.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3284-2.'],
              'id_perms': {'created': '2025-05-08T01:00:19.797848',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-05-08T01:00:19.797848',
                           'permissions': {'group': 'reader',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 12939394436992402722,
                                    'uuid_mslong': 18257103619479060983}},
              'parent_type': 'global-system-config',
              'parent_uuid': '8ebb224d-162d-466a-bdf6-32a738db0a8b',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'fd5e4302-fa8c-41f7-b391-f6af41990522'},
 'oper': 'CREATE',
 'request-id': 'req-b718710d-4671-4648-9f11-86e0d2062ca8',
 'type': 'analytics_snmp_node',
 'uuid': 'fd5e4302-fa8c-41f7-b391-f6af41990522'}
05/08/2025 01:00:20.523 7fa822080588 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3284-3.'],
 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.249',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3284-3.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3284-3.'],
              'id_perms': {'created': '2025-05-08T01:00:20.510151',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-05-08T01:00:20.510151',
                           'permissions': {'group': 'reader',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 11061250786782119237,
                                    'uuid_mslong': 2054646275302573605}},
              'parent_type': 'global-system-config',
              'parent_uuid': '8ebb224d-162d-466a-bdf6-32a738db0a8b',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '1c8391e6-c27d-4625-9981-74fc4da88545'},
 'oper': 'CREATE',
 'request-id': 'req-cade9f4d-4b54-4b86-8d61-83cbcb7e7a27',
 'type': 'analytics_snmp_node',
 'uuid': '1c8391e6-c27d-4625-9981-74fc4da88545'}
05/08/2025 01:00:20.643 7fa822080588 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3284-1.'],
 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.56',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3284-1.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3284-1.'],
              'id_perms': {'created': '2025-05-08T01:00:20.630371',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-05-08T01:00:20.630371',
                           'permissions': {'group': 'reader',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 11015602344563532715,
                                    'uuid_mslong': 4906077299830768782}},
              'parent_type': 'global-system-config',
              'parent_uuid': '8ebb224d-162d-466a-bdf6-32a738db0a8b',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '4415e34f-8905-448e-98df-47f81eab63ab'},
 'oper': 'CREATE',
 'request-id': 'req-943428e9-be61-4731-a165-b0a0ca543c34',
 'type': 'analytics_snmp_node',
 'uuid': '4415e34f-8905-448e-98df-47f81eab63ab'}
05/08/2025 01:01:59.529 7fa822080588 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'],
 'oper': 'UPDATE',
 'request-id': 'req-8a6f889c-5176-4fb0-8465-3c8db04ca69f',
 'type': 'global_system_config',
 'uuid': '8ebb224d-162d-466a-bdf6-32a738db0a8b'}
05/08/2025 01:01:59.615 7fa822080588 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'],
 'oper': 'UPDATE',
 'request-id': 'req-45436dc0-56c8-436e-8c67-225ccc9ec8f6',
 'type': 'global_system_config',
 'uuid': '8ebb224d-162d-466a-bdf6-32a738db0a8b'}
05/08/2025 01:01:59.667 7fa822080588 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-3284-2'],
 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-3284-2',
              'fq_name': ['default-global-system-config',
                          'an-jenkins-deploy-platform-ansible-os-3284-2'],
              'id_perms': {'created': '2025-05-08T01:01:59.657469',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-05-08T01:01:59.657469',
                           'permissions': {'group': 'reader',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 13258609804561196998,
                                    'uuid_mslong': 15447383346012046157}},
              'parent_type': 'global-system-config',
              'parent_uuid': '8ebb224d-162d-466a-bdf6-32a738db0a8b',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'd660214f-3855-434d-b800-0b5ec061a7c6',
              'virtual_router_dpdk_enabled': False,
              'virtual_router_ip_address': '10.20.0.193'},
 'oper': 'CREATE',
 'request-id': 'req-2c99b387-a5f9-4ce2-94e3-1740ee5535ae',
 'type': 'virtual_router',
 'uuid': 'd660214f-3855-434d-b800-0b5ec061a7c6'}
05/08/2025 01:01:59.741 7fa822080588 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-3284-1'],
 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-3284-1',
              'fq_name': ['default-global-system-config',
                          'an-jenkins-deploy-platform-ansible-os-3284-1'],
              'id_perms': {'created': '2025-05-08T01:01:59.732918',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-05-08T01:01:59.732918',
                           'permissions': {'group': 'reader',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 9622130248197774363,
                                    'uuid_mslong': 15277419406750271137}},
              'parent_type': 'global-system-config',
              'parent_uuid': '8ebb224d-162d-466a-bdf6-32a738db0a8b',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'd4044c01-d802-46a1-8588-ac7b025e9c1b',
              'virtual_router_dpdk_enabled': False,
              'virtual_router_ip_address': '10.20.0.25'},
 'oper': 'CREATE',
 'request-id': 'req-99b5ebd2-37ad-4be5-88ce-b0aee02d9036',
 'type': 'virtual_router',
 'uuid': 'd4044c01-d802-46a1-8588-ac7b025e9c1b'}
05/08/2025 01:02:00.032 7fa822080588 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-3284-2',
             'vhost0'],
 'obj_dict': {'display_name': 'vhost0',
              'fq_name': ['default-global-system-config',
                          'an-jenkins-deploy-platform-ansible-os-3284-2',
                          'vhost0'],
              'id_perms': {'created': '2025-05-08T01:02:00.006805',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-05-08T01:02:00.006805',
                           'permissions': {'group': 'reader',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 10083778784935828019,
                                    'uuid_mslong': 16920105974271331502}},
              'parent_type': 'virtual-router',
              'parent_uuid': 'd660214f-3855-434d-b800-0b5ec061a7c6',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'ead04abc-ae68-4cae-8bf0-c760f5b85a33',
              'virtual_machine_interface_disable_policy': True,
              'virtual_machine_interface_mac_addresses': {'mac_address': ['02:ea:d0:4a:bc:ae']},
              'virtual_network_refs': [{'to': ['default-domain',
                                               'default-project',
                                               'ip-fabric'],
                                        'uuid': '8a396a80-bce7-42b2-9267-be74ad9aac40'}]},
 'oper': 'CREATE',
 'request-id': 'req-46e7ef8e-4f30-4938-bcc1-538bd358c16a',
 'type': 'virtual_machine_interface',
 'uuid': 'ead04abc-ae68-4cae-8bf0-c760f5b85a33'}
05/08/2025 01:02:00.082 7fa822080588 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-3284-2',
             'vhost0'],
 'oper': 'UPDATE',
 'request-id': 'req-46e7ef8e-4f30-4938-bcc1-538bd358c16a',
 'type': 'virtual_machine_interface',
 'uuid': 'ead04abc-ae68-4cae-8bf0-c760f5b85a33'}
05/08/2025 01:02:00.132 7fa822080588 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-3284-1',
             'vhost0'],
 'obj_dict': {'display_name': 'vhost0',
              'fq_name': ['default-global-system-config',
                          'an-jenkins-deploy-platform-ansible-os-3284-1',
                          'vhost0'],
              'id_perms': {'created': '2025-05-08T01:02:00.109983',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-05-08T01:02:00.109983',
                           'permissions': {'group': 'reader',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 10389248471325859292,
                                    'uuid_mslong': 9033842404672620349}},
              'parent_type': 'virtual-router',
              'parent_uuid': 'd4044c01-d802-46a1-8588-ac7b025e9c1b',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '7d5ea7cd-bf5f-473d-902e-0670a8a5dddc',
              'virtual_machine_interface_disable_policy': True,
              'virtual_machine_interface_mac_addresses': {'mac_address': ['02:7d:5e:a7:cd:bf']},
              'virtual_network_refs': [{'to': ['default-domain',
                                               'default-project',
                                               'ip-fabric'],
                                        'uuid': '8a396a80-bce7-42b2-9267-be74ad9aac40'}]},
 'oper': 'CREATE',
 'request-id': 'req-f10b4ddb-fbea-494b-8c98-5ed2dcf83cdd',
 'type': 'virtual_machine_interface',
 'uuid': '7d5ea7cd-bf5f-473d-902e-0670a8a5dddc'}
05/08/2025 01:02:00.189 7fa822080588 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-3284-1',
             'vhost0'],
 'oper': 'UPDATE',
 'request-id': 'req-f10b4ddb-fbea-494b-8c98-5ed2dcf83cdd',
 'type': 'virtual_machine_interface',
 'uuid': '7d5ea7cd-bf5f-473d-902e-0670a8a5dddc'}
05/08/2025 01:02:00.580 7fa822080588 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'],
 'oper': 'UPDATE',
 'request-id': 'req-a8934b30-7709-4a53-ae7c-78ab36ded465',
 'type': 'access_control_list',
 'uuid': 'fd008aab-4be0-45b7-b335-3ba32ad6d969'}
05/08/2025 01:02:38.498 7fa822101630 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3284-2.: 95> in the [ObjectConfigNode:NodeStatusUVE] map
05/08/2025 01:02:58.213 7fa822101630 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3284-2.: 95> in the [ObjectConfigNode:NodeStatusUVE] map
05/08/2025 01:54:16.268 7fa8220d80f0 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3284-2.: 95> in the [ObjectConfigNode:NodeStatusUVE] map