06/23/2025 00:44:25.333 7faaad9da898 [contrail-topology] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0]
06/23/2025 00:44:25.333 7faaad9da898 [contrail-topology] [INFO]: SANDESH: Trace: PRINT: [None] -> [False]
06/23/2025 00:44:25.333 7faaad9da898 [contrail-topology] [INFO]: SANDESH: Flow Logging: [None] -> [False]
06/23/2025 00:44:25.333 7faaad9da898 [contrail-topology] [DEBUG]: Add uve <cn-jenkins-deploy-platform-ansible-os-3515-2., 1> in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map
06/23/2025 00:44:25.334 7faaad9da898 [contrail-topology] [INFO]: Consistent scheduler zk start
06/23/2025 00:44:25.334 7faaa7705d48 [contrail-topology] [ERROR]: Cannot write http_port 5921 to /tmp/contrail-topology.0.http_port
06/23/2025 00:44:25.334 7faaa7705d48 [contrail-topology] [ERROR]: Starting Introspect on HTTP Port 5921
06/23/2025 00:44:25.335 7faaa4c32848 [contrail-topology] [INFO]: Processing event[EvStart] in state[none]
06/23/2025 00:44:25.335 7faaa4c32848 [contrail-topology] [DEBUG]: Add uve <cn-jenkins-deploy-platform-ansible-os-3515-2.:AnalyticsSNMP:contrail-topology:0, 1> in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map
06/23/2025 00:44:25.335 7faaa4c32848 [contrail-topology] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle]
06/23/2025 00:44:25.335 7faaa4c32848 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/23/2025 00:44:25.335 7faaa4c32848 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3515-2.  process_status = [ <<  module_id = contrail-topology  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181,  ]  status = Initializing  description = Connection to Zookeeper initialized  >>,  ]  description = Zookeeper:Zookeeper[Connection to Zookeeper initialized] connection down  >>,  ]  >>  
06/23/2025 00:44:25.336 7faaa4c32848 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/23/2025 00:44:25.336 7faaa4c32848 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/23/2025 00:44:25.336 7faaa4c32848 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3515-2.  process_status = [ <<  module_id = contrail-topology  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181,  ]  status = Initializing  description = Connection to Zookeeper initialized  >>, <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>,  ]  description = Zookeeper:Zookeeper[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down  >>,  ]  >>  
06/23/2025 00:44:25.336 7faaa4c32848 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/23/2025 00:44:25.336 7faaa4c32848 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/23/2025 00:44:25.336 7faaa4c32848 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3515-2.:AnalyticsSNMP:contrail-topology:0  client_info = <<  status = Idle  successful_connections = 0  pid = 1  http_port = 5921  start_time = 1750639465335496  collector_name =   collector_ip =   collector_list = [ 10.0.0.19:8086, 10.0.0.49:8086, 10.0.0.41:8086,  ]  >>  sm_queue_count = 2  max_sm_queue_count = 2  >>  
06/23/2025 00:44:25.336 7faaa4c32848 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/23/2025 00:44:25.352 7faaa4baa848 [contrail-topology] [INFO]: Consistent scheduler listen CONNECTED
06/23/2025 00:44:25.352 7faaa4c32848 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/23/2025 00:44:25.353 7faaa4c32848 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3515-2.  process_status = [ <<  module_id = contrail-topology  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181,  ]  status = Up  description = Connection to Zookeeper established  >>, <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>,  ]  description = Collector:Collector[none to Idle on EvStart] connection down  >>,  ]  >>  
06/23/2025 00:44:25.353 7faaa4c32848 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/23/2025 00:44:25.599 7faaa4baab48 [contrail-topology] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.49:5673//', 'pyamqp://guest:guest@10.0.0.19:5673//', 'pyamqp://guest:guest@10.0.0.41:5673//']
06/23/2025 00:44:25.619 7faaa4baab48 [contrail-topology] [WARNING]: RabbitMQ drainer connection down
06/23/2025 00:44:25.621 7faaa4baae48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/23/2025 00:44:25.622 7faaa4baae48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3515-2.  process_status = [ <<  module_id = contrail-topology  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181,  ]  status = Up  description = Connection to Zookeeper established  >>, <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down  >>,  ]  >>  
06/23/2025 00:44:25.622 7faaa4baae48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/23/2025 00:44:25.622 7faaa4baae48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/23/2025 00:44:25.622 7faaa4baae48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3515-2.  process_status = [ <<  module_id = contrail-topology  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181,  ]  status = Up  description = Connection to Zookeeper established  >>, <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673,  ]  status = Down  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down  >>,  ]  >>  
06/23/2025 00:44:25.622 7faaa4baae48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/23/2025 00:44:25.639 7faaa4baab48 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.49:5673// at 0x7faaa3070fd0>
06/23/2025 00:44:25.640 7faaa4baae48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/23/2025 00:44:25.640 7faaa4baae48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3515-2.  process_status = [ <<  module_id = contrail-topology  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181,  ]  status = Up  description = Connection to Zookeeper established  >>, <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart] connection down  >>,  ]  >>  
06/23/2025 00:44:25.640 7faaa4baae48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/23/2025 00:44:25.666 7faaa4baaa48 [contrail-topology] [DEBUG]: Waiting for allocation...
06/23/2025 00:44:25.783 7faaa4baab48 [contrail-topology] [WARNING]: RabbitMQ publish connection down
06/23/2025 00:44:25.784 7faaa4baad48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/23/2025 00:44:25.784 7faaa4baad48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3515-2.  process_status = [ <<  module_id = contrail-topology  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181,  ]  status = Up  description = Connection to Zookeeper established  >>, <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673,  ]  status = Down  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down  >>,  ]  >>  
06/23/2025 00:44:25.784 7faaa4baad48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/23/2025 00:44:25.807 7faaa4baab48 [contrail-topology] [WARNING]: RabbitMQ publish connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.49:5673// at 0x7faaa3072c18>
06/23/2025 00:44:25.808 7faaa4baad48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/23/2025 00:44:25.808 7faaa4baad48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3515-2.  process_status = [ <<  module_id = contrail-topology  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181,  ]  status = Up  description = Connection to Zookeeper established  >>, <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart] connection down  >>,  ]  >>  
06/23/2025 00:44:25.808 7faaa4baad48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/23/2025 00:44:25.810 7faaa4baab48 [contrail-topology] [WARNING]: VNCCassandra started with driver cql
06/23/2025 00:44:25.810 7faaa4baab48 [contrail-topology] [WARNING]: initializing cassandra cluster
06/23/2025 00:44:25.810 7faaa4baab48 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster before create
06/23/2025 00:44:25.810 7faaa4baad48 [contrail-topology] [WARNING]: RabbitMQ publish connection down
06/23/2025 00:44:25.811 7faaa4baae48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/23/2025 00:44:25.811 7faaa4baae48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3515-2.  process_status = [ <<  module_id = contrail-topology  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181,  ]  status = Up  description = Connection to Zookeeper established  >>, <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down  >>,  ]  >>  
06/23/2025 00:44:25.811 7faaa4baae48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/23/2025 00:44:25.811 7faaa4baae48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/23/2025 00:44:25.812 7faaa4baae48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3515-2.  process_status = [ <<  module_id = contrail-topology  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181,  ]  status = Up  description = Connection to Zookeeper established  >>, <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673,  ]  status = Down  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[], Database:Cassandra[] connection down  >>,  ]  >>  
06/23/2025 00:44:25.812 7faaa4baae48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/23/2025 00:44:25.815 7faaa4baab48 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster created
06/23/2025 00:44:25.866 7faaa4baad48 [contrail-topology] [WARNING]: RabbitMQ publish connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.49:5673// at 0x7faaa3072c18>
06/23/2025 00:44:25.866 7faaa2feb248 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/23/2025 00:44:25.866 7faaa2feb248 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3515-2.  process_status = [ <<  module_id = contrail-topology  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181,  ]  status = Up  description = Connection to Zookeeper established  >>, <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down  >>,  ]  >>  
06/23/2025 00:44:25.867 7faaa2feb248 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/23/2025 00:44:25.907 7faaa4baab48 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected
06/23/2025 00:44:25.916 7faaa2febb48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/23/2025 00:44:25.917 7faaa2febb48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3515-2.  process_status = [ <<  module_id = contrail-topology  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181,  ]  status = Initializing  description =   >>, <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041,  ]  status = Initializing  description =   >>,  ]  description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down  >>,  ]  >>  
06/23/2025 00:44:25.917 7faaa2febb48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/23/2025 00:44:25.936 7faaa4baab48 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster init KS
06/23/2025 00:44:25.936 7faaa2feb648 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/23/2025 00:44:25.936 7faaa2feb648 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3515-2.  process_status = [ <<  module_id = contrail-topology  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181,  ]  status = Up  description =   >>, <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down  >>,  ]  >>  
06/23/2025 00:44:25.936 7faaa2feb648 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/23/2025 00:44:25.943 7faaa4baab48 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready
06/23/2025 00:44:25.982 7faaa4baab48 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready
06/23/2025 00:44:25.983 7faaa2f50948 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
06/23/2025 00:44:25.983 7faaa2f50948 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3515-2.  process_status = [ <<  module_id = contrail-topology  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181,  ]  status = Up  description =   >>, <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart] connection down  >>,  ]  >>  
06/23/2025 00:44:25.983 7faaa2f50948 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
06/23/2025 00:44:29.336 7faaa2f50b48 [contrail-topology] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
06/23/2025 00:44:29.337 7faaa2f50b48 [contrail-topology] [INFO]: Session Event: TCP Connected
06/23/2025 00:44:29.338 7faaa2f50b48 [contrail-topology] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
06/23/2025 00:44:29.338 7faaa2f50b48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
06/23/2025 00:44:29.338 7faaa2f50b48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3515-2.  process_status = [ <<  module_id = contrail-topology  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181,  ]  status = Up  description =   >>, <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
06/23/2025 00:44:29.338 7faaa2f50b48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
06/23/2025 00:44:29.338 7faaa2f50b48 [contrail-topology] [INFO]: Processing event[EvTcpConnected] in state[Connect]
06/23/2025 00:44:29.338 7faaa2f50b48 [contrail-topology] [DEBUG]: Send sandesh control message. uve type count # 5
06/23/2025 00:44:29.338 7faaa2f50b48 [contrail-topology] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit]
06/23/2025 00:44:29.339 7faaa2f50b48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit]
06/23/2025 00:44:29.339 7faaa2f50b48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit]
06/23/2025 00:44:29.339 7faaa2f50d48 [contrail-topology] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG]
06/23/2025 00:44:29.340 7faaa2f50d48 [contrail-topology] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID]
06/23/2025 00:44:29.345 7faaa2f50c48 [contrail-topology] [DEBUG]: Extracted sandesh length: 0000001017
06/23/2025 00:44:29.346 7faaa2f50c48 [contrail-topology] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient]
06/23/2025 00:44:29.347 7faaa2f50d48 [contrail-topology] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit]
06/23/2025 00:44:29.347 7faaa2f50d48 [contrail-topology] [DEBUG]: Number of uve types in sandesh control message is 0
06/23/2025 00:44:29.347 7faaa2f50d48 [contrail-topology] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3515-2.: 16> in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map
06/23/2025 00:44:29.347 7faaa2f50d48 [contrail-topology] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3515-2.:AnalyticsSNMP:contrail-topology:0: 2> in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map
06/23/2025 00:44:29.347 7faaa2f50d48 [contrail-topology] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established]
06/23/2025 00:44:29.348 7faaa4baa948 [contrail-topology] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG]
06/23/2025 00:44:29.349 7faaa4baa948 [contrail-topology] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID]
06/23/2025 00:44:56.681 7faaa4baaa48 [contrail-topology] [DEBUG]: Waiting for allocation...
06/23/2025 00:45:25.663 7faaa4c32848 [contrail-topology] [INFO]: members: ['cn-jenkins-deploy-platform-ansible-os-3515-2.-1', 'cn-jenkins-deploy-platform-ansible-os-3515-3.-1', 'cn-jenkins-deploy-platform-ansible-os-3515-1.-1']
06/23/2025 00:45:25.663 7faaa4c32848 [contrail-topology] [INFO]: partitions: ['4', '6', '10', '12', '17', '19', '22', '23', '26', '27', '30', '34', '35', '36', '38', '39', '40', '41', '45']
06/23/2025 00:45:26.946 7faaa4baaa48 [contrail-topology] [DEBUG]: got work:  ['4', '6', '10', '12', '17', '19', '22', '23', '26', '27', '30', '34', '35', '36', '38', '39', '40', '41', '45']
06/23/2025 00:45:26.947 7faaa4baaa48 [contrail-topology] [DEBUG]: @populate_work_items(): done!
06/23/2025 00:45:26.947 7faaa4baaa48 [contrail-topology] [DEBUG]: work items:  [] from the list []
06/23/2025 00:45:26.947 7faaa4baaa48 [contrail-topology] [DEBUG]: Add uve <cn-jenkins-deploy-platform-ansible-os-3515-2., 1> in the [ObjectAnalyticsSNMPInfo:TopologyUVE] map
06/23/2025 00:46:02.589 7faaa4baac48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'],
 'oper': 'UPDATE',
 'request-id': 'req-258fbfcc-8b53-4345-9655-81a48f3a8058',
 'type': 'global_system_config',
 'uuid': '6bb1ba73-f251-45cc-b691-850b471029f6'}
06/23/2025 00:46:02.617 7faaa4baac48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'],
 'oper': 'UPDATE',
 'request-id': 'req-5d428aeb-915f-4a70-b518-493f1fdd4dfa',
 'type': 'global_system_config',
 'uuid': '6bb1ba73-f251-45cc-b691-850b471029f6'}
06/23/2025 00:46:02.734 7faaa4baac48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-3515-1'],
 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-3515-1',
              'fq_name': ['default-global-system-config',
                          'an-jenkins-deploy-platform-ansible-os-3515-1'],
              'id_perms': {'created': '2025-06-23T00:46:02.725790',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-06-23T00:46:02.725790',
                           'permissions': {'group': 'heat_stack_owner',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 12015729256092671198,
                                    'uuid_mslong': 638969630244227909}},
              'parent_type': 'global-system-config',
              'parent_uuid': '6bb1ba73-f251-45cc-b691-850b471029f6',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '08de137e-48f8-4b45-a6c0-7218aaac1cde',
              'virtual_router_dpdk_enabled': False,
              'virtual_router_ip_address': '10.20.0.25'},
 'oper': 'CREATE',
 'request-id': 'req-8579f9ab-3237-44c9-9061-64b3917f4193',
 'type': 'virtual_router',
 'uuid': '08de137e-48f8-4b45-a6c0-7218aaac1cde'}
06/23/2025 00:46:02.787 7faaa4baac48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-3515-2'],
 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-3515-2',
              'fq_name': ['default-global-system-config',
                          'an-jenkins-deploy-platform-ansible-os-3515-2'],
              'id_perms': {'created': '2025-06-23T00:46:02.777364',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-06-23T00:46:02.777364',
                           'permissions': {'group': 'heat_stack_owner',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 13131383605618136228,
                                    'uuid_mslong': 582756256945293254}},
              'parent_type': 'global-system-config',
              'parent_uuid': '6bb1ba73-f251-45cc-b691-850b471029f6',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '08165dba-65dc-47c6-b63c-0bd0f641d4a4',
              'virtual_router_dpdk_enabled': False,
              'virtual_router_ip_address': '10.20.0.193'},
 'oper': 'CREATE',
 'request-id': 'req-58db5320-e8ce-43f9-a7b4-84e539cb31bc',
 'type': 'virtual_router',
 'uuid': '08165dba-65dc-47c6-b63c-0bd0f641d4a4'}
06/23/2025 00:46:03.126 7faaa4baac48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-3515-1',
             'vhost0'],
 'obj_dict': {'display_name': 'vhost0',
              'fq_name': ['default-global-system-config',
                          'an-jenkins-deploy-platform-ansible-os-3515-1',
                          'vhost0'],
              'id_perms': {'created': '2025-06-23T00:46:03.087055',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-06-23T00:46:03.087055',
                           'permissions': {'group': 'heat_stack_owner',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 13808408695167283556,
                                    'uuid_mslong': 11698381355008540990}},
              'parent_type': 'virtual-router',
              'parent_uuid': '08de137e-48f8-4b45-a6c0-7218aaac1cde',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'a258ffdc-9856-413e-bfa1-528c54dc7164',
              'virtual_machine_interface_disable_policy': True,
              'virtual_machine_interface_mac_addresses': {'mac_address': ['02:a2:58:ff:dc:98']},
              'virtual_network_refs': [{'to': ['default-domain',
                                               'default-project',
                                               'ip-fabric'],
                                        'uuid': 'e488264b-a209-43d7-b0b4-eab5a1f6df46'}]},
 'oper': 'CREATE',
 'request-id': 'req-9fa3ab85-3bd4-4849-8e30-8c5a702d39c2',
 'type': 'virtual_machine_interface',
 'uuid': 'a258ffdc-9856-413e-bfa1-528c54dc7164'}
06/23/2025 00:46:03.223 7faaa4baac48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-3515-1',
             'vhost0'],
 'oper': 'UPDATE',
 'request-id': 'req-9fa3ab85-3bd4-4849-8e30-8c5a702d39c2',
 'type': 'virtual_machine_interface',
 'uuid': 'a258ffdc-9856-413e-bfa1-528c54dc7164'}
06/23/2025 00:46:03.267 7faaa4baac48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-3515-2',
             'vhost0'],
 'obj_dict': {'display_name': 'vhost0',
              'fq_name': ['default-global-system-config',
                          'an-jenkins-deploy-platform-ansible-os-3515-2',
                          'vhost0'],
              'id_perms': {'created': '2025-06-23T00:46:03.205665',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-06-23T00:46:03.205665',
                           'permissions': {'group': 'heat_stack_owner',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 9806787067834754872,
                                    'uuid_mslong': 5773842293571209534}},
              'parent_type': 'virtual-router',
              'parent_uuid': '08165dba-65dc-47c6-b63c-0bd0f641d4a4',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '5020cef9-9170-493e-8818-b4e12e2f6738',
              'virtual_machine_interface_disable_policy': True,
              'virtual_machine_interface_mac_addresses': {'mac_address': ['02:50:20:ce:f9:91']},
              'virtual_network_refs': [{'to': ['default-domain',
                                               'default-project',
                                               'ip-fabric'],
                                        'uuid': 'e488264b-a209-43d7-b0b4-eab5a1f6df46'}]},
 'oper': 'CREATE',
 'request-id': 'req-13e490ab-cf7e-4769-af88-e2655a7f7de3',
 'type': 'virtual_machine_interface',
 'uuid': '5020cef9-9170-493e-8818-b4e12e2f6738'}
06/23/2025 00:46:03.363 7faaa4baac48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-3515-2',
             'vhost0'],
 'oper': 'UPDATE',
 'request-id': 'req-13e490ab-cf7e-4769-af88-e2655a7f7de3',
 'type': 'virtual_machine_interface',
 'uuid': '5020cef9-9170-493e-8818-b4e12e2f6738'}
06/23/2025 00:46:03.674 7faaa4baac48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'],
 'oper': 'UPDATE',
 'request-id': 'req-670c93af-7ca5-455c-8d45-8589334771db',
 'type': 'access_control_list',
 'uuid': 'a088b7b8-d3ce-455e-bf96-4890fb5f9514'}
06/23/2025 00:46:25.371 7faaa4baa948 [contrail-topology] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3515-2.: 17> in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map
06/23/2025 00:46:57.658 7faaa4baa948 [contrail-topology] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3515-2.: 17> in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map
06/23/2025 00:55:26.962 7faaa4baaa48 [contrail-topology] [DEBUG]: got work:  ['4', '6', '10', '12', '17', '19', '22', '23', '26', '27', '30', '34', '35', '36', '38', '39', '40', '41', '45']
06/23/2025 00:55:26.962 7faaa4baaa48 [contrail-topology] [DEBUG]: @populate_work_items(): done!
06/23/2025 00:55:26.963 7faaa4baaa48 [contrail-topology] [DEBUG]: work items:  [] from the list []
06/23/2025 01:05:26.979 7faaa4baaa48 [contrail-topology] [DEBUG]: got work:  ['4', '6', '10', '12', '17', '19', '22', '23', '26', '27', '30', '34', '35', '36', '38', '39', '40', '41', '45']
06/23/2025 01:05:26.979 7faaa4baaa48 [contrail-topology] [DEBUG]: @populate_work_items(): done!
06/23/2025 01:05:26.979 7faaa4baaa48 [contrail-topology] [DEBUG]: work items:  [] from the list []
06/23/2025 01:15:26.994 7faaa4baaa48 [contrail-topology] [DEBUG]: got work:  ['4', '6', '10', '12', '17', '19', '22', '23', '26', '27', '30', '34', '35', '36', '38', '39', '40', '41', '45']
06/23/2025 01:15:26.994 7faaa4baaa48 [contrail-topology] [DEBUG]: @populate_work_items(): done!
06/23/2025 01:15:26.994 7faaa4baaa48 [contrail-topology] [DEBUG]: work items:  [] from the list []
06/23/2025 01:25:27.056 7faaa4baaa48 [contrail-topology] [DEBUG]: got work:  ['4', '6', '10', '12', '17', '19', '22', '23', '26', '27', '30', '34', '35', '36', '38', '39', '40', '41', '45']
06/23/2025 01:25:27.056 7faaa4baaa48 [contrail-topology] [DEBUG]: @populate_work_items(): done!
06/23/2025 01:25:27.056 7faaa4baaa48 [contrail-topology] [DEBUG]: work items:  [] from the list []
06/23/2025 01:34:13.035 7faaa4c32848 [contrail-topology] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3515-2.: 17> in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map