06/05/2025 00:42:44.674 7fbd15f7cc88 [contrail-device-manager] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0]
06/05/2025 00:42:44.675 7fbd15f7cc88 [contrail-device-manager] [INFO]: SANDESH: Trace: PRINT: [None] -> [False]
06/05/2025 00:42:44.675 7fbd15f7cc88 [contrail-device-manager] [INFO]: SANDESH: Flow Logging: [None] -> [False]
06/05/2025 00:42:44.675 7fbd0d65a2e8 [contrail-device-manager] [INFO]: Processing event[EvStart] in state[none]
06/05/2025 00:42:44.676 7fbd0d65a2e8 [contrail-device-manager] [DEBUG]: Add uve <cn-jenkins-deploy-platform-ansible-os-3401-2., 1> in the [ObjectConfigNode:NodeStatusUVE] map
06/05/2025 00:42:44.677 7fbd0d65a2e8 [contrail-device-manager] [DEBUG]: Add uve <cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0, 1> in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map
06/05/2025 00:42:44.677 7fbd0d65a2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle]
06/05/2025 00:42:44.677 7fbd0d65a2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:42:44.677 7fbd0d65a2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>,  ]  description = Collector:Collector[none to Idle on EvStart] connection down  >>,  ]  >>  
06/05/2025 00:42:44.677 7fbd0d65a2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:42:44.677 7fbd0d65a2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:42:44.677 7fbd0d65a2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  start_time = 1749084164677019  collector_name =   collector_ip =   collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 1  >>  
06/05/2025 00:42:44.677 7fbd0d65a2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:42:44.719 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.249:5673//', 'pyamqp://guest:guest@10.0.0.27:5673//', 'pyamqp://guest:guest@10.0.0.131:5673//']
06/05/2025 00:42:44.728 7fbd15f7cc88 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down
06/05/2025 00:42:44.728 7fbd0d5ab588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:42:44.728 7fbd0d5ab588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down  >>,  ]  >>  
06/05/2025 00:42:44.729 7fbd0d5ab588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:42:44.729 7fbd0d5ab588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:42:44.729 7fbd0d5ab588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Down  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down  >>,  ]  >>  
06/05/2025 00:42:44.729 7fbd0d5ab588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:42:44.732 7fbd15f7cc88 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.249:5673// at 0x7fbd0d55d5f8>
06/05/2025 00:42:44.732 7fbd0d5ab240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:42:44.733 7fbd0d5ab240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart] connection down  >>,  ]  >>  
06/05/2025 00:42:44.733 7fbd0d5ab240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:42:44.758 7fbd15f7cc88 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down
06/05/2025 00:42:44.759 7fbd0d5ab0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:42:44.759 7fbd0d5ab0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Down  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down  >>,  ]  >>  
06/05/2025 00:42:44.759 7fbd0d5ab0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:42:44.762 7fbd15f7cc88 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.249:5673// at 0x7fbd0d5d4f98>
06/05/2025 00:42:44.762 7fbd1be5f978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:42:44.763 7fbd1be5f978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart] connection down  >>,  ]  >>  
06/05/2025 00:42:44.763 7fbd1be5f978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:42:44.818 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Removed remaining AMQP queue from previous run
06/05/2025 00:42:44.818 7fbd15f7cc88 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql
06/05/2025 00:42:44.819 7fbd15f7cc88 [contrail-device-manager] [WARNING]: initializing cassandra cluster
06/05/2025 00:42:44.819 7fbd15f7cc88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create
06/05/2025 00:42:44.819 7fbd12ee56d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting consumer greenlet
06/05/2025 00:42:44.819 7fbd12ee56d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection
06/05/2025 00:42:44.820 7fbd0fdf5978 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting publisher greenlet
06/05/2025 00:42:44.820 7fbd0fdf5978 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Publisher connection
06/05/2025 00:42:44.820 7fbd0d443588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:42:44.820 7fbd0d443588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down  >>,  ]  >>  
06/05/2025 00:42:44.820 7fbd0d443588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:42:44.821 7fbd15f7cc88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created
06/05/2025 00:42:44.826 7fbd12ee56d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established <Connection: amqp://guest:**@10.0.0.249:5673// at 0x7fbd0d4463c8>
06/05/2025 00:42:44.826 7fbd12ee56d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Waiting for consumer
06/05/2025 00:42:44.826 7fbd0fdf5978 [contrail-device-manager] [INFO]: KombuAmqpClient: Publisher connection established <Connection: amqp://guest:**@10.0.0.249:5673// at 0x7fbd0d4463c8>
06/05/2025 00:42:44.907 7fbd15f7cc88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected
06/05/2025 00:42:44.909 7fbd0d399978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:42:44.909 7fbd0d399978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[], Zookeeper:Zookeeper[] connection down  >>,  ]  >>  
06/05/2025 00:42:44.909 7fbd0d399978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:42:44.917 7fbd15f7cc88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS
06/05/2025 00:42:44.917 7fbd0d39bf60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:42:44.918 7fbd0d39bf60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down  >>,  ]  >>  
06/05/2025 00:42:44.918 7fbd0d39bf60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:42:44.925 7fbd15f7cc88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready
06/05/2025 00:42:44.955 7fbd15f7cc88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready
06/05/2025 00:42:46.218 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
06/05/2025 00:42:47.201 7fbd15f7cc88 [contrail-device-manager] [WARNING]: table 'obj_uuid_table', created
06/05/2025 00:42:47.208 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
06/05/2025 00:42:48.323 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
06/05/2025 00:42:48.677 7fbd0d31cac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:42:48.679 7fbd0d31cac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
06/05/2025 00:42:48.679 7fbd0d31cac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:42:48.679 7fbd0d31cac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:42:48.679 7fbd0d31cac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
06/05/2025 00:42:48.679 7fbd0d31cac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:42:48.679 7fbd0d31cac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
06/05/2025 00:42:48.679 7fbd0d31cac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
06/05/2025 00:42:48.680 7fbd0d31cac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:42:48.680 7fbd0d31cac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
06/05/2025 00:42:48.680 7fbd0d31cac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:42:48.680 7fbd0d31cac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:42:48.680 7fbd0d31cac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  start_time = 1749084164677019  collector_name =   collector_ip = 10.0.0.249:8086  collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
06/05/2025 00:42:48.680 7fbd0d31cac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:42:49.219 7fbd15f7cc88 [contrail-device-manager] [WARNING]: table 'obj_uuid_table' fixed with properties {'gc_grace_seconds': 864000}
06/05/2025 00:42:49.226 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
06/05/2025 00:42:51.250 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
06/05/2025 00:42:52.231 7fbd15f7cc88 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table', created
06/05/2025 00:42:52.239 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
06/05/2025 00:42:52.680 7fbd0e194438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:42:52.681 7fbd0e194438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
06/05/2025 00:42:52.681 7fbd0e194438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:42:52.681 7fbd0e194438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:42:52.682 7fbd0e194438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.131:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
06/05/2025 00:42:52.682 7fbd0e194438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:42:52.682 7fbd0e194438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
06/05/2025 00:42:52.682 7fbd0e194438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
06/05/2025 00:42:52.682 7fbd0e194438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:42:52.682 7fbd0e194438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.131:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
06/05/2025 00:42:52.682 7fbd0e194438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:42:52.682 7fbd0e194438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:42:52.682 7fbd0e194438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  start_time = 1749084164677019  collector_name =   collector_ip = 10.0.0.131:8086  collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
06/05/2025 00:42:52.682 7fbd0e194438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:42:55.094 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
06/05/2025 00:42:56.196 7fbd15f7cc88 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table' fixed with properties {'gc_grace_seconds': 864000}
06/05/2025 00:42:56.202 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
06/05/2025 00:42:56.682 7fbd0d33dc18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:42:56.683 7fbd0d33dc18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
06/05/2025 00:42:56.683 7fbd0d33dc18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:42:56.683 7fbd0d33dc18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:42:56.683 7fbd0d33dc18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
06/05/2025 00:42:56.683 7fbd0d33dc18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:42:56.683 7fbd0d33dc18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
06/05/2025 00:42:56.684 7fbd0d33dc18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
06/05/2025 00:42:56.684 7fbd0d33dc18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:42:56.684 7fbd0d33dc18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
06/05/2025 00:42:56.684 7fbd0d33dc18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:42:56.684 7fbd0d33dc18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:42:56.684 7fbd0d33dc18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  start_time = 1749084164677019  collector_name =   collector_ip = 10.0.0.27:8086  collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
06/05/2025 00:42:56.684 7fbd0d33dc18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:42:58.180 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
06/05/2025 00:42:58.184 7fbd15f7cc88 [contrail-device-manager] [WARNING]: table 'obj_shared_table', created
06/05/2025 00:42:58.187 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
06/05/2025 00:42:59.801 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
06/05/2025 00:43:00.303 7fbd15f7cc88 [contrail-device-manager] [WARNING]: table 'obj_shared_table' fixed with properties {'gc_grace_seconds': 864000}
06/05/2025 00:43:00.309 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
06/05/2025 00:43:00.309 7fbd0d35cac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:00.310 7fbd0d35cac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
06/05/2025 00:43:00.310 7fbd0d35cac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:00.324 7fbd15f7cc88 [contrail-device-manager] [ERROR]: Error in db walk read 'type'
06/05/2025 00:43:00.325 7fbd0cac4438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:00.325 7fbd0cac4438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Zookeeper:Zookeeper[] connection down  >>,  ]  >>  
06/05/2025 00:43:00.325 7fbd0cac4438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:00.334 7fbd0cabf978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:00.335 7fbd0cabf978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
06/05/2025 00:43:00.335 7fbd0cabf978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:00.335 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_status_consumer.dummy
06/05/2025 00:43:00.335 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_request_consumer
06/05/2025 00:43:00.335 7fbd12ee56d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection
06/05/2025 00:43:00.336 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3401-2.
06/05/2025 00:43:00.342 7fbd12ee56d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established <Connection: amqp://guest:**@10.0.0.249:5673// at 0x7fbd0d4463c8>
06/05/2025 00:43:00.584 7fbd12ee56d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3401-2.']
06/05/2025 00:43:00.623 7fbd12ee56d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection
06/05/2025 00:43:00.630 7fbd12ee56d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established <Connection: amqp://guest:**@10.0.0.249:5673// at 0x7fbd0d4463c8>
06/05/2025 00:43:00.684 7fbd0d3192e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:43:00.686 7fbd0d3192e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
06/05/2025 00:43:00.686 7fbd0d3192e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:43:00.686 7fbd0d3192e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:43:00.686 7fbd0d3192e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
06/05/2025 00:43:00.686 7fbd0d3192e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:43:00.686 7fbd0d3192e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
06/05/2025 00:43:00.687 7fbd0d3192e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
06/05/2025 00:43:00.687 7fbd0d3192e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:00.687 7fbd0d3192e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
06/05/2025 00:43:00.687 7fbd0d3192e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:00.687 7fbd0d3192e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:00.687 7fbd0d3192e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  start_time = 1749084164677019  collector_name =   collector_ip = 10.0.0.249:8086  collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
06/05/2025 00:43:00.687 7fbd0d3192e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:00.710 7fbd12ee56d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3401-2.']
06/05/2025 00:43:00.847 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Fetching all containers
06/05/2025 00:43:00.883 7fbd15f7cc88 [contrail-device-manager] [INFO]: Restarting dnsmasq docker: config_dnsmasq_1
06/05/2025 00:43:01.057 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3401-2..config_queue
06/05/2025 00:43:01.058 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3401-2..tftp_queue
06/05/2025 00:43:01.558 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Process 138 prepared to run in Full mode...
06/05/2025 00:43:01.558 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Elected master Device Manager node. Initializing... 
06/05/2025 00:43:01.558 7fbd15f7cc88 [contrail-device-manager] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8096
06/05/2025 00:43:01.561 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add [config_updater.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/config_updater] to home page
06/05/2025 00:43:01.561 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_ConfigApiUpdateReq]
06/05/2025 00:43:01.562 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add [greenlets.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/greenlets] to home page
06/05/2025 00:43:01.562 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_GreenletObjectReq]
06/05/2025 00:43:01.562 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add [cpuinfo.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/nodeinfo/cpuinfo] to home page
06/05/2025 00:43:01.562 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CpuLoadInfoReq]
06/05/2025 00:43:01.566 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add [dm_introspect.xml:/usr/lib/python3.6/site-packages/device_manager/sandesh/dm_introspect] to home page
06/05/2025 00:43:01.566 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_RoutingInstanceList]
06/05/2025 00:43:01.566 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualNetworkList]
06/05/2025 00:43:01.566 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualMachineInterfaceList]
06/05/2025 00:43:01.566 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalInterfaceList]
06/05/2025 00:43:01.566 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalInterfaceList]
06/05/2025 00:43:01.566 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalRouterList]
06/05/2025 00:43:01.566 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_BgpRouterList]
06/05/2025 00:43:01.566 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalRouterList]
06/05/2025 00:43:01.566 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_InstanceIpList]
06/05/2025 00:43:01.567 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FloatingIpList]
06/05/2025 00:43:01.567 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PortTupleList]
06/05/2025 00:43:01.567 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FeatureFlagList]
06/05/2025 00:43:01.568 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add [sandesh_alarm.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_alarm] to home page
06/05/2025 00:43:01.568 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmCacheRequest]
06/05/2025 00:43:01.568 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmTypesRequest]
06/05/2025 00:43:01.568 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmAckRequest]
06/05/2025 00:43:01.568 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add [sandesh_ctrl.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_ctrl] to home page
06/05/2025 00:43:01.569 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlClientToServer]
06/05/2025 00:43:01.569 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlServerToClient]
06/05/2025 00:43:01.569 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add [sandesh_trace.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_trace] to home page
06/05/2025 00:43:01.569 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceRequest]
06/05/2025 00:43:01.569 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferListRequest]
06/05/2025 00:43:01.569 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceEnableDisableReq]
06/05/2025 00:43:01.569 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufStatusReq]
06/05/2025 00:43:01.569 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferEnableDisableReq]
06/05/2025 00:43:01.570 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add [sandesh_uve.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_uve] to home page
06/05/2025 00:43:01.570 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshMessageStatsReq]
06/05/2025 00:43:01.570 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsSet]
06/05/2025 00:43:01.570 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsStatus]
06/05/2025 00:43:01.570 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsSet]
06/05/2025 00:43:01.570 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsStatus]
06/05/2025 00:43:01.570 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsSet]
06/05/2025 00:43:01.570 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsReset]
06/05/2025 00:43:01.571 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsStatus]
06/05/2025 00:43:01.571 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueSet]
06/05/2025 00:43:01.571 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueStatus]
06/05/2025 00:43:01.571 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CollectorInfoRequest]
06/05/2025 00:43:01.571 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVEDSConfReq]
06/05/2025 00:43:01.571 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVECacheReq]
06/05/2025 00:43:01.571 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVETypesReq]
06/05/2025 00:43:01.573 7fbd15f7cc88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.ztp_queue
06/05/2025 00:43:01.585 7fbd0ca67390 [contrail-device-manager] [ERROR]: Cannot write http_port 8096 to /tmp/contrail-device-manager.1.http_port
06/05/2025 00:43:01.585 7fbd0ca67390 [contrail-device-manager] [ERROR]: Starting Introspect on HTTP Port 8096
06/05/2025 00:43:01.630 7fbd0c2546d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:01.630 7fbd0c2546d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Initializing  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down  >>,  ]  >>  
06/05/2025 00:43:01.630 7fbd0c2546d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:01.639 7fbd0c12db70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:01.639 7fbd0c12db70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Down  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down  >>,  ]  >>  
06/05/2025 00:43:01.639 7fbd0c12db70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:01.728 7fbd12ee56d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection
06/05/2025 00:43:01.733 7fbd12ee56d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established <Connection: amqp://guest:**@10.0.0.249:5673// at 0x7fbd0d4463c8>
06/05/2025 00:43:01.992 7fbd12ee56d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3401-2.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3401-2..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3401-2..tftp_queue', 'device_manager_ztp.ztp_queue']
06/05/2025 00:43:04.686 7fbd0c060780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:43:04.688 7fbd0c060780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
06/05/2025 00:43:04.689 7fbd0c060780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:43:04.689 7fbd0c060780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:43:04.689 7fbd0c060780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.131:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Down  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down  >>,  ]  >>  
06/05/2025 00:43:04.689 7fbd0c060780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:43:04.689 7fbd0c060780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
06/05/2025 00:43:04.689 7fbd0c060780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
06/05/2025 00:43:04.689 7fbd0c060780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:04.690 7fbd0c060780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.131:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Down  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down  >>,  ]  >>  
06/05/2025 00:43:04.690 7fbd0c060780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:04.690 7fbd0c060780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:04.690 7fbd0c060780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1749084164677019  collector_name =   collector_ip = 10.0.0.131:8086  collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
06/05/2025 00:43:04.690 7fbd0c060780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:07.766 7fbd0c0d36d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:07.766 7fbd0c0d36d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.131:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
06/05/2025 00:43:07.766 7fbd0c0d36d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:08.689 7fbd0c053b70 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:43:08.690 7fbd0c053b70 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
06/05/2025 00:43:08.690 7fbd0c053b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:43:08.690 7fbd0c053b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:43:08.690 7fbd0c053b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
06/05/2025 00:43:08.690 7fbd0c053b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:43:08.691 7fbd0c053b70 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
06/05/2025 00:43:08.691 7fbd0c053b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
06/05/2025 00:43:08.691 7fbd0c053b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:08.691 7fbd0c053b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
06/05/2025 00:43:08.691 7fbd0c053b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:08.691 7fbd0c053b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:08.691 7fbd0c053b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1749084164677019  collector_name =   collector_ip = 10.0.0.27:8086  collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
06/05/2025 00:43:08.691 7fbd0c053b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:12.691 7fbd07fcd2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:43:12.692 7fbd07fcd2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
06/05/2025 00:43:12.692 7fbd07fcd2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:43:12.693 7fbd07fcd2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:43:12.693 7fbd07fcd2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
06/05/2025 00:43:12.693 7fbd07fcd2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:43:12.693 7fbd07fcd2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
06/05/2025 00:43:12.693 7fbd07fcd2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
06/05/2025 00:43:12.693 7fbd07fcd2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:12.694 7fbd07fcd2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
06/05/2025 00:43:12.694 7fbd07fcd2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:12.694 7fbd07fcd2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:12.694 7fbd07fcd2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1749084164677019  collector_name =   collector_ip = 10.0.0.249:8086  collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
06/05/2025 00:43:12.694 7fbd07fcd2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:16.693 7fbd0c058630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:43:16.694 7fbd0c058630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
06/05/2025 00:43:16.695 7fbd0c058630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:43:16.695 7fbd0c058630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:43:16.695 7fbd0c058630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.131:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
06/05/2025 00:43:16.695 7fbd0c058630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:43:16.695 7fbd0c058630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
06/05/2025 00:43:16.696 7fbd0c058630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
06/05/2025 00:43:16.696 7fbd0c058630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:16.696 7fbd0c058630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.131:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
06/05/2025 00:43:16.696 7fbd0c058630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:16.696 7fbd0c058630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:16.696 7fbd0c058630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1749084164677019  collector_name =   collector_ip = 10.0.0.131:8086  collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
06/05/2025 00:43:16.696 7fbd0c058630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:20.696 7fbd0c053588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:43:20.697 7fbd0c053588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
06/05/2025 00:43:20.697 7fbd0c053588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:43:20.697 7fbd0c053588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:43:20.697 7fbd0c053588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
06/05/2025 00:43:20.698 7fbd0c053588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:43:20.698 7fbd0c053588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
06/05/2025 00:43:20.698 7fbd0c053588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
06/05/2025 00:43:20.698 7fbd0c053588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:20.698 7fbd0c053588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
06/05/2025 00:43:20.698 7fbd0c053588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:20.698 7fbd0c053588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:20.698 7fbd0c053588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1749084164677019  collector_name =   collector_ip = 10.0.0.27:8086  collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
06/05/2025 00:43:20.698 7fbd0c053588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:24.698 7fbd0c053588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:43:24.700 7fbd0c053588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
06/05/2025 00:43:24.700 7fbd0c053588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:43:24.701 7fbd0c053588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:43:24.701 7fbd0c053588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
06/05/2025 00:43:24.701 7fbd0c053588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:43:24.701 7fbd0c053588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
06/05/2025 00:43:24.701 7fbd0c053588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
06/05/2025 00:43:24.701 7fbd0c053588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:24.701 7fbd0c053588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
06/05/2025 00:43:24.702 7fbd0c053588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:24.702 7fbd0c053588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:24.702 7fbd0c053588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1749084164677019  collector_name =   collector_ip = 10.0.0.249:8086  collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
06/05/2025 00:43:24.702 7fbd0c053588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:28.702 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:43:28.703 7fbd0ca0a4e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
06/05/2025 00:43:28.703 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:43:28.703 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:43:28.703 7fbd0ca0a4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.131:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
06/05/2025 00:43:28.703 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:43:28.703 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
06/05/2025 00:43:28.704 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
06/05/2025 00:43:28.704 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:28.704 7fbd0ca0a4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.131:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
06/05/2025 00:43:28.704 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:28.704 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:28.704 7fbd0ca0a4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1749084164677019  collector_name =   collector_ip = 10.0.0.131:8086  collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
06/05/2025 00:43:28.704 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:32.704 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:43:32.706 7fbd0ca0a4e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
06/05/2025 00:43:32.706 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:43:32.706 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:43:32.706 7fbd0ca0a4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
06/05/2025 00:43:32.706 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:43:32.706 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
06/05/2025 00:43:32.706 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
06/05/2025 00:43:32.706 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:32.706 7fbd0ca0a4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
06/05/2025 00:43:32.706 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:32.707 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:32.707 7fbd0ca0a4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1749084164677019  collector_name =   collector_ip = 10.0.0.27:8086  collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
06/05/2025 00:43:32.707 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:36.707 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:43:36.709 7fbd0ca0a4e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
06/05/2025 00:43:36.709 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:43:36.709 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:43:36.709 7fbd0ca0a4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
06/05/2025 00:43:36.709 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:43:36.709 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
06/05/2025 00:43:36.710 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
06/05/2025 00:43:36.710 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:36.710 7fbd0ca0a4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
06/05/2025 00:43:36.710 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:36.710 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:36.710 7fbd0ca0a4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1749084164677019  collector_name =   collector_ip = 10.0.0.249:8086  collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
06/05/2025 00:43:36.710 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:40.710 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:43:40.712 7fbd0ca0a4e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
06/05/2025 00:43:40.712 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:43:40.712 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:43:40.712 7fbd0ca0a4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.131:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
06/05/2025 00:43:40.712 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:43:40.712 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
06/05/2025 00:43:40.713 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
06/05/2025 00:43:40.713 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:40.713 7fbd0ca0a4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.131:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
06/05/2025 00:43:40.713 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:40.713 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:40.713 7fbd0ca0a4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1749084164677019  collector_name =   collector_ip = 10.0.0.131:8086  collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
06/05/2025 00:43:40.713 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:44.713 7fbd0e1f74e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:43:44.713 7fbd0e1f74e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
06/05/2025 00:43:44.714 7fbd0e1f74e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:43:44.714 7fbd0e1f74e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:43:44.714 7fbd0e1f74e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
06/05/2025 00:43:44.714 7fbd0e1f74e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:43:44.714 7fbd0e1f74e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
06/05/2025 00:43:44.714 7fbd0e1f74e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
06/05/2025 00:43:44.714 7fbd0e1f74e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:44.715 7fbd0e1f74e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
06/05/2025 00:43:44.715 7fbd0e1f74e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:44.715 7fbd0e1f74e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:44.715 7fbd0e1f74e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1749084164677019  collector_name =   collector_ip = 10.0.0.27:8086  collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
06/05/2025 00:43:44.715 7fbd0e1f74e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:48.714 7fbd0d332d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:43:48.715 7fbd0d332d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
06/05/2025 00:43:48.715 7fbd0d332d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:43:48.715 7fbd0d332d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:43:48.715 7fbd0d332d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
06/05/2025 00:43:48.716 7fbd0d332d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:43:48.716 7fbd0d332d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
06/05/2025 00:43:48.716 7fbd0d332d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
06/05/2025 00:43:48.716 7fbd0d332d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:48.716 7fbd0d332d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
06/05/2025 00:43:48.716 7fbd0d332d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:48.716 7fbd0d332d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:48.716 7fbd0d332d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1749084164677019  collector_name =   collector_ip = 10.0.0.249:8086  collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
06/05/2025 00:43:48.716 7fbd0d332d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:52.716 7fbd0d332d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:43:52.717 7fbd0d332d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
06/05/2025 00:43:52.718 7fbd0d332d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:43:52.718 7fbd0d332d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:43:52.718 7fbd0d332d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.131:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
06/05/2025 00:43:52.718 7fbd0d332d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:43:52.718 7fbd0d332d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
06/05/2025 00:43:52.718 7fbd0d332d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
06/05/2025 00:43:52.718 7fbd0d332d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:52.718 7fbd0d332d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.131:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
06/05/2025 00:43:52.718 7fbd0d332d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:52.718 7fbd0d332d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:52.718 7fbd0d332d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1749084164677019  collector_name =   collector_ip = 10.0.0.131:8086  collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
06/05/2025 00:43:52.719 7fbd0d332d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:56.718 7fbd13130828 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:43:56.719 7fbd13130828 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
06/05/2025 00:43:56.720 7fbd13130828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:43:56.720 7fbd13130828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:43:56.720 7fbd13130828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
06/05/2025 00:43:56.720 7fbd13130828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:43:56.720 7fbd13130828 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
06/05/2025 00:43:56.720 7fbd13130828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
06/05/2025 00:43:56.720 7fbd13130828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:56.720 7fbd13130828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
06/05/2025 00:43:56.720 7fbd13130828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:56.720 7fbd13130828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:43:56.720 7fbd13130828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1749084164677019  collector_name =   collector_ip = 10.0.0.27:8086  collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
06/05/2025 00:43:56.721 7fbd13130828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:00.720 7fbd1364ba20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:44:00.721 7fbd1364ba20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
06/05/2025 00:44:00.721 7fbd1364ba20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:44:00.722 7fbd1364ba20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:44:00.722 7fbd1364ba20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
06/05/2025 00:44:00.722 7fbd1364ba20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:44:00.722 7fbd1364ba20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
06/05/2025 00:44:00.722 7fbd1364ba20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
06/05/2025 00:44:00.722 7fbd1364ba20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:00.722 7fbd1364ba20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
06/05/2025 00:44:00.722 7fbd1364ba20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:00.722 7fbd1364ba20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:00.722 7fbd1364ba20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1749084164677019  collector_name =   collector_ip = 10.0.0.249:8086  collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
06/05/2025 00:44:00.722 7fbd1364ba20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:04.722 7fbd0cabfac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:44:04.724 7fbd0cabfac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
06/05/2025 00:44:04.724 7fbd0cabfac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:44:04.724 7fbd0cabfac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:44:04.724 7fbd0cabfac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.131:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
06/05/2025 00:44:04.724 7fbd0cabfac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:44:04.724 7fbd0cabfac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
06/05/2025 00:44:04.725 7fbd0cabfac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
06/05/2025 00:44:04.725 7fbd0cabfac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:04.725 7fbd0cabfac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.131:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
06/05/2025 00:44:04.725 7fbd0cabfac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:04.725 7fbd0cabfac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:04.725 7fbd0cabfac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1749084164677019  collector_name =   collector_ip = 10.0.0.131:8086  collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
06/05/2025 00:44:04.725 7fbd0cabfac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:08.725 7fbd130ac630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:44:08.726 7fbd130ac630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
06/05/2025 00:44:08.727 7fbd130ac630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:44:08.727 7fbd130ac630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:44:08.727 7fbd130ac630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
06/05/2025 00:44:08.727 7fbd130ac630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:44:08.727 7fbd130ac630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
06/05/2025 00:44:08.728 7fbd130ac630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
06/05/2025 00:44:08.728 7fbd130ac630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:08.728 7fbd130ac630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
06/05/2025 00:44:08.728 7fbd130ac630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:08.728 7fbd130ac630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:08.728 7fbd130ac630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1749084164677019  collector_name =   collector_ip = 10.0.0.27:8086  collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
06/05/2025 00:44:08.728 7fbd130ac630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:12.727 7fbd0d32d630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:44:12.728 7fbd0d32d630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
06/05/2025 00:44:12.728 7fbd0d32d630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:44:12.728 7fbd0d32d630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:44:12.729 7fbd0d32d630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
06/05/2025 00:44:12.729 7fbd0d32d630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:44:12.729 7fbd0d32d630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
06/05/2025 00:44:12.729 7fbd0d32d630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
06/05/2025 00:44:12.729 7fbd0d32d630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:12.729 7fbd0d32d630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
06/05/2025 00:44:12.729 7fbd0d32d630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:12.729 7fbd0d32d630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:12.729 7fbd0d32d630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1749084164677019  collector_name =   collector_ip = 10.0.0.249:8086  collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
06/05/2025 00:44:12.729 7fbd0d32d630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:16.729 7fbd0c254f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:44:16.731 7fbd0c254f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
06/05/2025 00:44:16.731 7fbd0c254f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:44:16.731 7fbd0c254f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:44:16.731 7fbd0c254f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.131:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
06/05/2025 00:44:16.731 7fbd0c254f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:44:16.731 7fbd0c254f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
06/05/2025 00:44:16.732 7fbd0c254f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
06/05/2025 00:44:16.732 7fbd0c254f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:16.732 7fbd0c254f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.131:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
06/05/2025 00:44:16.732 7fbd0c254f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:16.732 7fbd0c254f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:16.732 7fbd0c254f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1749084164677019  collector_name =   collector_ip = 10.0.0.131:8086  collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
06/05/2025 00:44:16.732 7fbd0c254f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:20.732 7fbd0d332d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:44:20.736 7fbd0d332d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
06/05/2025 00:44:20.736 7fbd0d332d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:44:20.736 7fbd0d332d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:44:20.736 7fbd0d332d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
06/05/2025 00:44:20.736 7fbd0d332d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:44:20.736 7fbd0d332d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
06/05/2025 00:44:20.736 7fbd0d332d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
06/05/2025 00:44:20.737 7fbd0d332d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:20.737 7fbd0d332d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
06/05/2025 00:44:20.737 7fbd0d332d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:20.737 7fbd0d332d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:20.737 7fbd0d332d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1749084164677019  collector_name =   collector_ip = 10.0.0.27:8086  collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
06/05/2025 00:44:20.738 7fbd0d332d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:24.736 7fbd0d332d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:44:24.737 7fbd0d332d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
06/05/2025 00:44:24.738 7fbd0d332d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:44:24.738 7fbd0d332d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:44:24.738 7fbd0d332d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
06/05/2025 00:44:24.738 7fbd0d332d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:44:24.738 7fbd0d332d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
06/05/2025 00:44:24.738 7fbd0d332d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
06/05/2025 00:44:24.738 7fbd0d332d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:24.738 7fbd0d332d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
06/05/2025 00:44:24.738 7fbd0d332d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:24.738 7fbd0d332d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:24.739 7fbd0d332d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1749084164677019  collector_name =   collector_ip = 10.0.0.249:8086  collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
06/05/2025 00:44:24.739 7fbd0d332d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:26.291 7fbd15f7cc88 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql
06/05/2025 00:44:26.291 7fbd15f7cc88 [contrail-device-manager] [WARNING]: initializing cassandra cluster
06/05/2025 00:44:26.291 7fbd15f7cc88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create
06/05/2025 00:44:26.292 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:26.292 7fbd0ca0a4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
06/05/2025 00:44:26.292 7fbd0ca0a4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:26.293 7fbd15f7cc88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created
06/05/2025 00:44:26.316 7fbd15f7cc88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected
06/05/2025 00:44:26.317 7fbd0c204cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:26.318 7fbd0c204cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Initializing  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[], Zookeeper:Zookeeper[] connection down  >>,  ]  >>  
06/05/2025 00:44:26.318 7fbd0c204cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:26.345 7fbd15f7cc88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS
06/05/2025 00:44:26.346 7fbd0c204ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:26.346 7fbd0c204ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
06/05/2025 00:44:26.346 7fbd0c204ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:26.380 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
06/05/2025 00:44:27.071 7fbd15f7cc88 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace', created
06/05/2025 00:44:27.079 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
06/05/2025 00:44:27.087 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
06/05/2025 00:44:27.370 7fbd15f7cc88 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None}
06/05/2025 00:44:27.374 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
06/05/2025 00:44:27.374 7fbd15f7cc88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready
06/05/2025 00:44:27.445 7fbd15f7cc88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready
06/05/2025 00:44:27.465 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
06/05/2025 00:44:28.146 7fbd15f7cc88 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table', created
06/05/2025 00:44:28.157 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
06/05/2025 00:44:28.165 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
06/05/2025 00:44:28.738 7fbd07f0aeb8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:44:28.739 7fbd07f0aeb8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
06/05/2025 00:44:28.739 7fbd07f0aeb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:44:28.739 7fbd07f0aeb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:44:28.740 7fbd07f0aeb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.131:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
06/05/2025 00:44:28.740 7fbd07f0aeb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:44:28.740 7fbd07f0aeb8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
06/05/2025 00:44:28.740 7fbd07f0aeb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
06/05/2025 00:44:28.740 7fbd07f0aeb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:28.740 7fbd07f0aeb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.131:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
06/05/2025 00:44:28.740 7fbd07f0aeb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:28.740 7fbd07f0aeb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:28.740 7fbd07f0aeb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1749084164677019  collector_name =   collector_ip = 10.0.0.131:8086  collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
06/05/2025 00:44:28.740 7fbd07f0aeb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:29.242 7fbd15f7cc88 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table' fixed with properties {'gc_grace_seconds': 864000}
06/05/2025 00:44:29.246 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
06/05/2025 00:44:29.258 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
06/05/2025 00:44:30.393 7fbd15f7cc88 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table', created
06/05/2025 00:44:30.400 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
06/05/2025 00:44:30.405 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
06/05/2025 00:44:31.111 7fbd15f7cc88 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table' fixed with properties {'gc_grace_seconds': 864000}
06/05/2025 00:44:31.117 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
06/05/2025 00:44:31.124 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
06/05/2025 00:44:32.256 7fbd15f7cc88 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table', created
06/05/2025 00:44:32.262 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
06/05/2025 00:44:32.269 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
06/05/2025 00:44:32.740 7fbd07f14cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:44:32.741 7fbd07f14cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
06/05/2025 00:44:32.741 7fbd07f14cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:44:32.741 7fbd07f14cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:44:32.742 7fbd07f14cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
06/05/2025 00:44:32.742 7fbd07f14cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:44:32.742 7fbd07f14cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
06/05/2025 00:44:32.742 7fbd07f14cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
06/05/2025 00:44:32.742 7fbd07f14cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:32.742 7fbd07f14cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
06/05/2025 00:44:32.742 7fbd07f14cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:32.742 7fbd07f14cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:32.742 7fbd07f14cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1749084164677019  collector_name =   collector_ip = 10.0.0.27:8086  collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
06/05/2025 00:44:32.742 7fbd07f14cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:33.381 7fbd15f7cc88 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table' fixed with properties {'gc_grace_seconds': 864000}
06/05/2025 00:44:33.385 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
06/05/2025 00:44:33.390 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
06/05/2025 00:44:34.111 7fbd15f7cc88 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table', created
06/05/2025 00:44:34.116 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
06/05/2025 00:44:34.123 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
06/05/2025 00:44:35.210 7fbd15f7cc88 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table' fixed with properties {'gc_grace_seconds': 864000}
06/05/2025 00:44:35.215 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Zookeeper lock released.
06/05/2025 00:44:35.215 7fbd0d332d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:35.216 7fbd0d332d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
06/05/2025 00:44:35.216 7fbd0d332d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:35.271 7fbd15f7cc88 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.249:5673//', 'pyamqp://guest:guest@10.0.0.27:5673//', 'pyamqp://guest:guest@10.0.0.131:5673//']
06/05/2025 00:44:35.271 7fbd15f7cc88 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down
06/05/2025 00:44:35.271 7fbd07f1c240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:35.272 7fbd07f1c240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Initializing  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down  >>,  ]  >>  
06/05/2025 00:44:35.272 7fbd07f1c240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:35.272 7fbd07f1c240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:35.272 7fbd07f1c240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Down  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down  >>,  ]  >>  
06/05/2025 00:44:35.272 7fbd07f1c240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:35.275 7fbd15f7cc88 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.249:5673// at 0x7fbd0d44ad68>
06/05/2025 00:44:35.276 7fbd07f1c048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:35.276 7fbd07f1c048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
06/05/2025 00:44:35.276 7fbd07f1c048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:35.303 7fbd15f7cc88 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down
06/05/2025 00:44:35.304 7fbd07f1c6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:35.304 7fbd07f1c6d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Down  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down  >>,  ]  >>  
06/05/2025 00:44:35.304 7fbd07f1c6d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:35.307 7fbd15f7cc88 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.249:5673// at 0x7fbd07ec9dd8>
06/05/2025 00:44:35.308 7fbd07f1c048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:35.308 7fbd07f1c048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
06/05/2025 00:44:35.308 7fbd07f1c048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:35.309 7fbd07f1c780 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down
06/05/2025 00:44:35.310 7fbd07f19d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:35.310 7fbd07f19d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Down  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down  >>,  ]  >>  
06/05/2025 00:44:35.310 7fbd07f19d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:35.313 7fbd07f1c780 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.249:5673// at 0x7fbd07ec9dd8>
06/05/2025 00:44:35.314 7fbd07f13f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:35.314 7fbd07f13f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
06/05/2025 00:44:35.314 7fbd07f13f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:36.742 7fbd130c7c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:44:36.743 7fbd130c7c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
06/05/2025 00:44:36.744 7fbd130c7c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:44:36.744 7fbd130c7c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:44:36.744 7fbd130c7c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
06/05/2025 00:44:36.744 7fbd130c7c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:44:36.744 7fbd130c7c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
06/05/2025 00:44:36.744 7fbd130c7c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
06/05/2025 00:44:36.744 7fbd130c7c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:36.744 7fbd130c7c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
06/05/2025 00:44:36.744 7fbd130c7c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:36.744 7fbd130c7c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:36.744 7fbd130c7c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1749084164677019  collector_name =   collector_ip = 10.0.0.249:8086  collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
06/05/2025 00:44:36.745 7fbd130c7c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:40.745 7fbd130c7c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:44:40.746 7fbd130c7c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
06/05/2025 00:44:40.746 7fbd130c7c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:44:40.746 7fbd130c7c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:44:40.747 7fbd130c7c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.131:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
06/05/2025 00:44:40.747 7fbd130c7c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:44:40.747 7fbd130c7c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
06/05/2025 00:44:40.747 7fbd130c7c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
06/05/2025 00:44:40.747 7fbd130c7c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:40.747 7fbd130c7c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.131:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
06/05/2025 00:44:40.747 7fbd130c7c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:40.747 7fbd130c7c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:40.747 7fbd130c7c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1749084164677019  collector_name =   collector_ip = 10.0.0.131:8086  collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
06/05/2025 00:44:40.747 7fbd130c7c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:44.748 7fbd130c7c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:44:44.749 7fbd130c7c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
06/05/2025 00:44:44.749 7fbd130c7c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:44:44.749 7fbd130c7c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:44:44.749 7fbd130c7c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
06/05/2025 00:44:44.749 7fbd130c7c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:44:44.749 7fbd130c7c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
06/05/2025 00:44:44.749 7fbd130c7c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
06/05/2025 00:44:44.749 7fbd130c7c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:44.749 7fbd130c7c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
06/05/2025 00:44:44.750 7fbd130c7c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:44.750 7fbd130c7c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:44.750 7fbd130c7c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1749084164677019  collector_name =   collector_ip = 10.0.0.27:8086  collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
06/05/2025 00:44:44.750 7fbd130c7c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:48.750 7fbd130c7c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:44:48.751 7fbd130c7c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
06/05/2025 00:44:48.751 7fbd130c7c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:44:48.751 7fbd130c7c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:44:48.752 7fbd130c7c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
06/05/2025 00:44:48.752 7fbd130c7c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:44:48.752 7fbd130c7c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
06/05/2025 00:44:48.752 7fbd130c7c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
06/05/2025 00:44:48.752 7fbd130c7c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:48.752 7fbd130c7c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.249:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
06/05/2025 00:44:48.752 7fbd130c7c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:48.753 7fbd130c7c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:48.753 7fbd130c7c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1749084164677019  collector_name =   collector_ip = 10.0.0.249:8086  collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
06/05/2025 00:44:48.753 7fbd130c7c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:44:51.223 7fbd07f1c048 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3401-2.'],
 'obj_dict': {'analytics_node_ip_address': '10.0.0.27',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3401-2.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3401-2.'],
              'id_perms': {'created': '2025-06-05T00:44:51.213345',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-06-05T00:44:51.213345',
                           'permissions': {'group': 'heat_stack_owner',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 12258580778671307101,
                                    'uuid_mslong': 12522310142462938078}},
              'parent_type': 'global-system-config',
              'parent_uuid': '7685c044-9f7d-4d52-9039-0babc11f3849',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'adc82eba-80c6-4bde-aa1f-3a44fb22795d'},
 'oper': 'CREATE',
 'request-id': 'req-3e3c3d25-396e-4cbd-be38-b4b4fa8c5143',
 'type': 'analytics_node',
 'uuid': 'adc82eba-80c6-4bde-aa1f-3a44fb22795d'}
06/05/2025 00:44:51.580 7fbd07f1c048 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3401-3.'],
 'obj_dict': {'analytics_node_ip_address': '10.0.0.131',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3401-3.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3401-3.'],
              'id_perms': {'created': '2025-06-05T00:44:51.574064',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-06-05T00:44:51.574064',
                           'permissions': {'group': 'heat_stack_owner',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 12275442357693205624,
                                    'uuid_mslong': 2502582431540069277}},
              'parent_type': 'global-system-config',
              'parent_uuid': '7685c044-9f7d-4d52-9039-0babc11f3849',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '22baf576-5514-439d-aa5b-21c947164c78'},
 'oper': 'CREATE',
 'request-id': 'req-3104904b-4649-4925-bc51-ea5f82c34848',
 'type': 'analytics_node',
 'uuid': '22baf576-5514-439d-aa5b-21c947164c78'}
06/05/2025 00:44:51.631 7fbd07f1c048 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3401-1.'],
 'obj_dict': {'analytics_node_ip_address': '10.0.0.249',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3401-1.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3401-1.'],
              'id_perms': {'created': '2025-06-05T00:44:51.620038',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-06-05T00:44:51.620038',
                           'permissions': {'group': 'heat_stack_owner',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 10786200523915027991,
                                    'uuid_mslong': 11178323251275714087}},
              'parent_type': 'global-system-config',
              'parent_uuid': '7685c044-9f7d-4d52-9039-0babc11f3849',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '9b2161c5-90c7-4e27-95b0-483a90166617'},
 'oper': 'CREATE',
 'request-id': 'req-84990855-ec77-4afd-a4c4-5dba58fdc3dd',
 'type': 'analytics_node',
 'uuid': '9b2161c5-90c7-4e27-95b0-483a90166617'}
06/05/2025 00:44:52.753 7fbd07ee0048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:44:52.754 7fbd07ee0048 [contrail-device-manager] [INFO]: Session Event: TCP Connected
06/05/2025 00:44:52.754 7fbd07ee0048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:44:52.754 7fbd07ee0048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:44:52.754 7fbd07ee0048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.131:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
06/05/2025 00:44:52.754 7fbd07ee0048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:44:52.754 7fbd07ee0048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnected] in state[Connect]
06/05/2025 00:44:52.755 7fbd07ee0048 [contrail-device-manager] [DEBUG]: Send sandesh control message. uve type count # 19
06/05/2025 00:44:52.755 7fbd07ee0048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit]
06/05/2025 00:44:52.755 7fbd07ee0048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit]
06/05/2025 00:44:52.756 7fbd07ee0048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit]
06/05/2025 00:44:52.756 7fbd07f0af60 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG]
06/05/2025 00:44:52.757 7fbd07f0af60 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID]
06/05/2025 00:45:00.759 7fbd07f0a828 [contrail-device-manager] [ERROR]: Session Event: TCP Connection Closed
06/05/2025 00:45:00.761 7fbd07ee0048 [contrail-device-manager] [INFO]: Processing event[EvTcpClose] in state[ClientInit]
06/05/2025 00:45:00.761 7fbd07ee0048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle]
06/05/2025 00:45:00.761 7fbd07ee0048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:45:00.761 7fbd07ee0048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.131:8086,  ]  status = Down  description = ClientInit to Idle on EvTcpClose  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[ClientInit to Idle on EvTcpClose] connection down  >>,  ]  >>  
06/05/2025 00:45:00.761 7fbd07ee0048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:45:00.761 7fbd07ee0048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:45:00.762 7fbd07ee0048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 1  pid = 138  http_port = 8096  start_time = 1749084164677019  collector_name =   collector_ip = 10.0.0.131:8086  collector_list = [ 10.0.0.249:8086, 10.0.0.131:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
06/05/2025 00:45:00.762 7fbd07ee0048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/05/2025 00:45:04.762 7fbd07ee0048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/05/2025 00:45:04.763 7fbd07ee0048 [contrail-device-manager] [INFO]: Session Event: TCP Connected
06/05/2025 00:45:04.763 7fbd07ee0048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/05/2025 00:45:04.763 7fbd07ee0048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:45:04.763 7fbd07ee0048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3401-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.249:9041, 10.0.0.27:9041, 10.0.0.131:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.249,10.0.0.27,10.0.0.131:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
06/05/2025 00:45:04.763 7fbd07ee0048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/05/2025 00:45:04.763 7fbd07ee0048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnected] in state[Connect]
06/05/2025 00:45:04.764 7fbd07ee0048 [contrail-device-manager] [DEBUG]: Send sandesh control message. uve type count # 19
06/05/2025 00:45:04.764 7fbd07ee0048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit]
06/05/2025 00:45:04.764 7fbd07ee0048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit]
06/05/2025 00:45:04.764 7fbd07ee0048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit]
06/05/2025 00:45:04.764 7fbd07f144e0 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG]
06/05/2025 00:45:04.765 7fbd07f144e0 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID]
06/05/2025 00:45:04.772 7fbd07f0a240 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001017
06/05/2025 00:45:04.772 7fbd07f0a240 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient]
06/05/2025 00:45:04.772 7fbd0d5d56d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit]
06/05/2025 00:45:04.772 7fbd0d5d56d8 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 0
06/05/2025 00:45:04.773 7fbd0d5d56d8 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3401-2.: 93> in the [ObjectConfigNode:NodeStatusUVE] map
06/05/2025 00:45:04.773 7fbd0d5d56d8 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0: 35> in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map
06/05/2025 00:45:04.773 7fbd0d5d56d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established]
06/05/2025 00:45:04.773 7fbd07f0aa20 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG]
06/05/2025 00:45:04.774 7fbd07f0aa20 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID]
06/05/2025 00:45:05.637 7fbd07f1c048 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3401-2.'],
 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.27',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3401-2.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3401-2.'],
              'id_perms': {'created': '2025-06-05T00:45:05.599913',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-06-05T00:45:05.599913',
                           'permissions': {'group': 'heat_stack_owner',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 12140513898363009089,
                                    'uuid_mslong': 927682996130302943}},
              'parent_type': 'global-system-config',
              'parent_uuid': '7685c044-9f7d-4d52-9039-0babc11f3849',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '0cdfcac5-1884-4bdf-a87b-c5113e9eb841'},
 'oper': 'CREATE',
 'request-id': 'req-298c2c32-a42d-4aac-ac27-6244795946b5',
 'type': 'analytics_alarm_node',
 'uuid': '0cdfcac5-1884-4bdf-a87b-c5113e9eb841'}
06/05/2025 00:45:05.717 7fbd07f1c048 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3401-1.'],
 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.249',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3401-1.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3401-1.'],
              'id_perms': {'created': '2025-06-05T00:45:05.701630',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-06-05T00:45:05.701630',
                           'permissions': {'group': 'heat_stack_owner',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 10437080831613541529,
                                    'uuid_mslong': 11133914016394264674}},
              'parent_type': 'global-system-config',
              'parent_uuid': '7685c044-9f7d-4d52-9039-0babc11f3849',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '9a839bce-d2ec-4062-90d7-f5b7e45d1c99'},
 'oper': 'CREATE',
 'request-id': 'req-3b81db93-3dae-425a-a3fb-42b56e541fcf',
 'type': 'analytics_alarm_node',
 'uuid': '9a839bce-d2ec-4062-90d7-f5b7e45d1c99'}
06/05/2025 00:45:06.330 7fbd07f1c048 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3401-3.'],
 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.131',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3401-3.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3401-3.'],
              'id_perms': {'created': '2025-06-05T00:45:06.324398',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-06-05T00:45:06.324398',
                           'permissions': {'group': 'heat_stack_owner',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 10160479791702503177,
                                    'uuid_mslong': 9464980796216987175}},
              'parent_type': 'global-system-config',
              'parent_uuid': '7685c044-9f7d-4d52-9039-0babc11f3849',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '835a5de2-f468-4e27-8d01-4689bbf66f09'},
 'oper': 'CREATE',
 'request-id': 'req-dd28ce25-1cc6-42a4-904d-bb5c1619e615',
 'type': 'analytics_alarm_node',
 'uuid': '835a5de2-f468-4e27-8d01-4689bbf66f09'}
06/05/2025 00:45:11.116 7fbd07f0a240 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001296
06/05/2025 00:45:11.116 7fbd07f0a240 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient]
06/05/2025 00:45:11.117 7fbd0e271048 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established]
06/05/2025 00:45:11.117 7fbd0e271048 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 2
06/05/2025 00:45:11.117 7fbd0e271048 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3401-2.: 94> in the [ObjectConfigNode:NodeStatusUVE] map
06/05/2025 00:45:11.117 7fbd0e271048 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3401-2.:Config:contrail-device-manager:0: 36> in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map
06/05/2025 00:45:14.955 7fbd07f1c048 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3401-2.'],
 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.27',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3401-2.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3401-2.'],
              'id_perms': {'created': '2025-06-05T00:45:14.933814',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-06-05T00:45:14.933814',
                           'permissions': {'group': 'heat_stack_owner',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 12136433134538251619,
                                    'uuid_mslong': 8398218639955413650}},
              'parent_type': 'global-system-config',
              'parent_uuid': '7685c044-9f7d-4d52-9039-0babc11f3849',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '748c775b-7c9b-4a92-a86d-45a2606edd63'},
 'oper': 'CREATE',
 'request-id': 'req-f589d1b4-de81-4058-9c55-a57cedfd9c97',
 'type': 'analytics_snmp_node',
 'uuid': '748c775b-7c9b-4a92-a86d-45a2606edd63'}
06/05/2025 00:45:15.022 7fbd07f1c048 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3401-1.'],
 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.249',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3401-1.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3401-1.'],
              'id_perms': {'created': '2025-06-05T00:45:15.012767',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-06-05T00:45:15.012767',
                           'permissions': {'group': 'heat_stack_owner',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 12066526750452113282,
                                    'uuid_mslong': 4080849027848881632}},
              'parent_type': 'global-system-config',
              'parent_uuid': '7685c044-9f7d-4d52-9039-0babc11f3849',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '38a21691-ceee-45e0-a774-ea25f9725f82'},
 'oper': 'CREATE',
 'request-id': 'req-f2d0d5e9-ab1e-46de-983a-48490416f9d3',
 'type': 'analytics_snmp_node',
 'uuid': '38a21691-ceee-45e0-a774-ea25f9725f82'}
06/05/2025 00:45:16.067 7fbd07f1c048 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3401-3.'],
 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.131',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3401-3.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3401-3.'],
              'id_perms': {'created': '2025-06-05T00:45:16.049248',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-06-05T00:45:16.049248',
                           'permissions': {'group': 'heat_stack_owner',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 10596034689880759227,
                                    'uuid_mslong': 18103568829223488811}},
              'parent_type': 'global-system-config',
              'parent_uuid': '7685c044-9f7d-4d52-9039-0babc11f3849',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'fb3ccbee-f0b3-4d2b-930c-ad69060f1bbb'},
 'oper': 'CREATE',
 'request-id': 'req-ea6c88c2-2759-4c6f-8106-bb816dfa69fb',
 'type': 'analytics_snmp_node',
 'uuid': 'fb3ccbee-f0b3-4d2b-930c-ad69060f1bbb'}
06/05/2025 00:46:55.515 7fbd07f1c048 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'],
 'oper': 'UPDATE',
 'request-id': 'req-f6a17767-f471-4b98-ba91-1cfdf4b638e1',
 'type': 'global_system_config',
 'uuid': '7685c044-9f7d-4d52-9039-0babc11f3849'}
06/05/2025 00:46:55.657 7fbd07f1c048 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-3401-2'],
 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-3401-2',
              'fq_name': ['default-global-system-config',
                          'an-jenkins-deploy-platform-ansible-os-3401-2'],
              'id_perms': {'created': '2025-06-05T00:46:55.640517',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-06-05T00:46:55.640517',
                           'permissions': {'group': 'heat_stack_owner',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 11130148355826326220,
                                    'uuid_mslong': 3599767279899134208}},
              'parent_type': 'global-system-config',
              'parent_uuid': '7685c044-9f7d-4d52-9039-0babc11f3849',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '31f4f144-c876-4900-9a76-3af5a66d1acc',
              'virtual_router_dpdk_enabled': False,
              'virtual_router_ip_address': '10.20.0.193'},
 'oper': 'CREATE',
 'request-id': 'req-1f3bc652-69e3-4db1-b979-e6df4fc3a3e8',
 'type': 'virtual_router',
 'uuid': '31f4f144-c876-4900-9a76-3af5a66d1acc'}
06/05/2025 00:46:55.992 7fbd07f1c048 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-3401-2',
             'vhost0'],
 'obj_dict': {'display_name': 'vhost0',
              'fq_name': ['default-global-system-config',
                          'an-jenkins-deploy-platform-ansible-os-3401-2',
                          'vhost0'],
              'id_perms': {'created': '2025-06-05T00:46:55.976693',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-06-05T00:46:55.976693',
                           'permissions': {'group': 'heat_stack_owner',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 13089009622088256425,
                                    'uuid_mslong': 5912294089183284161}},
              'parent_type': 'virtual-router',
              'parent_uuid': '31f4f144-c876-4900-9a76-3af5a66d1acc',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '520cb026-4169-4bc1-b5a5-80e71a3d8ba9',
              'virtual_machine_interface_disable_policy': True,
              'virtual_machine_interface_mac_addresses': {'mac_address': ['02:52:0c:b0:26:41']},
              'virtual_network_refs': [{'to': ['default-domain',
                                               'default-project',
                                               'ip-fabric'],
                                        'uuid': '98a68765-400c-42d7-849e-e430b8719b6d'}]},
 'oper': 'CREATE',
 'request-id': 'req-66a36709-af65-4e2d-bf1d-31cdbf05ac16',
 'type': 'virtual_machine_interface',
 'uuid': '520cb026-4169-4bc1-b5a5-80e71a3d8ba9'}
06/05/2025 00:46:56.035 7fbd07f1c048 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-3401-2',
             'vhost0'],
 'oper': 'UPDATE',
 'request-id': 'req-66a36709-af65-4e2d-bf1d-31cdbf05ac16',
 'type': 'virtual_machine_interface',
 'uuid': '520cb026-4169-4bc1-b5a5-80e71a3d8ba9'}
06/05/2025 00:46:56.290 7fbd07f1c048 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-3401-1'],
 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-3401-1',
              'fq_name': ['default-global-system-config',
                          'an-jenkins-deploy-platform-ansible-os-3401-1'],
              'id_perms': {'created': '2025-06-05T00:46:56.284111',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-06-05T00:46:56.284111',
                           'permissions': {'group': 'heat_stack_owner',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 11857002851222459896,
                                    'uuid_mslong': 8416889699372126042}},
              'parent_type': 'global-system-config',
              'parent_uuid': '7685c044-9f7d-4d52-9039-0babc11f3849',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '74cecc96-44b8-4f5a-a48c-8945a7e895f8',
              'virtual_router_dpdk_enabled': False,
              'virtual_router_ip_address': '10.20.0.25'},
 'oper': 'CREATE',
 'request-id': 'req-9bcac08a-12cb-46dd-a586-79468cd30018',
 'type': 'virtual_router',
 'uuid': '74cecc96-44b8-4f5a-a48c-8945a7e895f8'}
06/05/2025 00:46:56.547 7fbd07f1c048 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'],
 'oper': 'UPDATE',
 'request-id': 'req-f38a07f0-f8bf-4172-bfdc-b43bdd388bee',
 'type': 'access_control_list',
 'uuid': '09df5933-56a8-4624-bb39-6f82cee0bcf8'}
06/05/2025 00:46:56.630 7fbd07f1c048 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-3401-1',
             'vhost0'],
 'obj_dict': {'display_name': 'vhost0',
              'fq_name': ['default-global-system-config',
                          'an-jenkins-deploy-platform-ansible-os-3401-1',
                          'vhost0'],
              'id_perms': {'created': '2025-06-05T00:46:56.613495',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-06-05T00:46:56.613495',
                           'permissions': {'group': 'heat_stack_owner',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 13466647569305989790,
                                    'uuid_mslong': 15917060270280624010}},
              'parent_type': 'virtual-router',
              'parent_uuid': '74cecc96-44b8-4f5a-a48c-8945a7e895f8',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'dce4c1fb-ce8f-478a-bae3-249d6bdc729e',
              'virtual_machine_interface_disable_policy': True,
              'virtual_machine_interface_mac_addresses': {'mac_address': ['02:dc:e4:c1:fb:ce']},
              'virtual_network_refs': [{'to': ['default-domain',
                                               'default-project',
                                               'ip-fabric'],
                                        'uuid': '98a68765-400c-42d7-849e-e430b8719b6d'}]},
 'oper': 'CREATE',
 'request-id': 'req-cc9ea0c7-21c7-4552-a588-ccfccdf1ac8b',
 'type': 'virtual_machine_interface',
 'uuid': 'dce4c1fb-ce8f-478a-bae3-249d6bdc729e'}
06/05/2025 00:46:56.669 7fbd07f1c048 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-3401-1',
             'vhost0'],
 'oper': 'UPDATE',
 'request-id': 'req-cc9ea0c7-21c7-4552-a588-ccfccdf1ac8b',
 'type': 'virtual_machine_interface',
 'uuid': 'dce4c1fb-ce8f-478a-bae3-249d6bdc729e'}
06/05/2025 00:47:32.247 7fbd143848d0 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3401-2.: 94> in the [ObjectConfigNode:NodeStatusUVE] map
06/05/2025 00:47:54.992 7fbd143848d0 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3401-2.: 94> in the [ObjectConfigNode:NodeStatusUVE] map
06/05/2025 01:44:39.352 7fbd07ee0588 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3401-2.: 94> in the [ObjectConfigNode:NodeStatusUVE] map