09/02/2024 02:02:08.391 7f3a19421c48 [contrail-topology] [ERROR]: Cannot write http_port 5921 to /tmp/contrail-topology.0.http_port
09/02/2024 02:02:08.392 7f3a19421c48 [contrail-topology] [ERROR]: Starting Introspect on HTTP Port 5921
09/02/2024 02:02:08.392 7f3a1690a748 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-k8s-manifests-84-1.cluster.local  process_status = [ <<  module_id = contrail-topology  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.43:2181,  ]  status = Initializing  description = Connection to Zookeeper initialized  >>,  ]  description = Zookeeper:Zookeeper[Connection to Zookeeper initialized] connection down  >>,  ]  >>  
09/02/2024 02:02:08.392 7f3a1690a748 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-k8s-manifests-84-1.cluster.local  process_status = [ <<  module_id = contrail-topology  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.43:2181,  ]  status = Initializing  description = Connection to Zookeeper initialized  >>, <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>,  ]  description = Zookeeper:Zookeeper[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down  >>,  ]  >>  
09/02/2024 02:02:08.393 7f3a1690a748 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-k8s-manifests-84-1.cluster.local:AnalyticsSNMP:contrail-topology:0  client_info = <<  status = Idle  successful_connections = 0  pid = 1  http_port = 5921  start_time = 1725242528392468  collector_name =   collector_ip =   collector_list = [ 10.0.0.43:8086,  ]  >>  sm_queue_count = 2  max_sm_queue_count = 2  >>  
09/02/2024 02:02:08.423 7f3a1690a748 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-k8s-manifests-84-1.cluster.local  process_status = [ <<  module_id = contrail-topology  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.43:2181,  ]  status = Up  description = Connection to Zookeeper established  >>, <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>,  ]  description = Collector:Collector[none to Idle on EvStart] connection down  >>,  ]  >>  
09/02/2024 02:02:08.594 7f3a1694c948 [contrail-topology] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.43:5673//']
09/02/2024 02:02:08.600 7f3a1694c948 [contrail-topology] [WARNING]: RabbitMQ drainer connection down
09/02/2024 02:02:08.601 7f3a1694cd48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-k8s-manifests-84-1.cluster.local  process_status = [ <<  module_id = contrail-topology  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.43:2181,  ]  status = Up  description = Connection to Zookeeper established  >>, <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.43:5673,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down  >>,  ]  >>  
09/02/2024 02:02:08.601 7f3a1694cd48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-k8s-manifests-84-1.cluster.local  process_status = [ <<  module_id = contrail-topology  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.43:2181,  ]  status = Up  description = Connection to Zookeeper established  >>, <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.43:5673,  ]  status = Down  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down  >>,  ]  >>  
09/02/2024 02:02:08.634 7f3a1694c948 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.43:5673// at 0x7f3a14d7eb70>
09/02/2024 02:02:08.634 7f3a1694cd48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-k8s-manifests-84-1.cluster.local  process_status = [ <<  module_id = contrail-topology  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.43:2181,  ]  status = Up  description = Connection to Zookeeper established  >>, <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.43:5673,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart] connection down  >>,  ]  >>  
09/02/2024 02:02:08.676 7f3a1694c948 [contrail-topology] [WARNING]: RabbitMQ publish connection down
09/02/2024 02:02:08.676 7f3a1694cd48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-k8s-manifests-84-1.cluster.local  process_status = [ <<  module_id = contrail-topology  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.43:2181,  ]  status = Up  description = Connection to Zookeeper established  >>, <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.43:5673,  ]  status = Down  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down  >>,  ]  >>  
09/02/2024 02:02:08.701 7f3a1694c948 [contrail-topology] [WARNING]: RabbitMQ publish connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.43:5673// at 0x7f3a14d83da0>
09/02/2024 02:02:08.701 7f3a1694cd48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-k8s-manifests-84-1.cluster.local  process_status = [ <<  module_id = contrail-topology  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.43:2181,  ]  status = Up  description = Connection to Zookeeper established  >>, <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.43:5673,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart] connection down  >>,  ]  >>  
09/02/2024 02:02:08.704 7f3a1694c948 [contrail-topology] [WARNING]: VNCCassandra started with driver cql
09/02/2024 02:02:08.704 7f3a1694c948 [contrail-topology] [WARNING]: initializing cassandra cluster
09/02/2024 02:02:08.704 7f3a1694c948 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster before create
09/02/2024 02:02:08.704 7f3a1694cd48 [contrail-topology] [WARNING]: RabbitMQ publish connection down
09/02/2024 02:02:08.705 7f3a1508ca48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-k8s-manifests-84-1.cluster.local  process_status = [ <<  module_id = contrail-topology  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.43:2181,  ]  status = Up  description = Connection to Zookeeper established  >>, <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.43:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.43:9041,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down  >>,  ]  >>  
09/02/2024 02:02:08.705 7f3a1508ca48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-k8s-manifests-84-1.cluster.local  process_status = [ <<  module_id = contrail-topology  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.43:2181,  ]  status = Up  description = Connection to Zookeeper established  >>, <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.43:5673,  ]  status = Down  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.43:9041,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[], Database:Cassandra[] connection down  >>,  ]  >>  
09/02/2024 02:02:08.708 7f3a1694c948 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster created
09/02/2024 02:02:08.741 7f3a1694cd48 [contrail-topology] [WARNING]: RabbitMQ publish connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.43:5673// at 0x7f3a14d83da0>
09/02/2024 02:02:08.742 7f3a14cf9348 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-k8s-manifests-84-1.cluster.local  process_status = [ <<  module_id = contrail-topology  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.43:2181,  ]  status = Up  description = Connection to Zookeeper established  >>, <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.43:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.43:9041,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down  >>,  ]  >>  
09/02/2024 02:02:08.865 7f3a1694c948 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected
09/02/2024 02:02:08.866 7f3a14cf9648 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-k8s-manifests-84-1.cluster.local  process_status = [ <<  module_id = contrail-topology  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.43:2181,  ]  status = Initializing  description =   >>, <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.43:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.43:9041,  ]  status = Initializing  description =   >>,  ]  description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down  >>,  ]  >>  
09/02/2024 02:02:08.929 7f3a1694c948 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster init KS
09/02/2024 02:02:08.930 7f3a14cf9648 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-k8s-manifests-84-1.cluster.local  process_status = [ <<  module_id = contrail-topology  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.43:2181,  ]  status = Up  description =   >>, <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.43:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.43:9041,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down  >>,  ]  >>  
09/02/2024 02:02:08.984 7f3a1694c948 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready
09/02/2024 02:02:09.129 7f3a1694c948 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready
09/02/2024 02:02:09.716 7f3a1694c948 [contrail-topology] [WARNING]: Zookeeper lock acquired. Performing schema change...
09/02/2024 02:02:10.027 7f3a1694c948 [contrail-topology] [WARNING]: table 'obj_shared_table', created
09/02/2024 02:02:10.040 7f3a1694c948 [contrail-topology] [WARNING]: Zookeeper lock released.
09/02/2024 02:02:11.056 7f3a1694c948 [contrail-topology] [WARNING]: Zookeeper lock acquired. Performing schema change...
09/02/2024 02:02:11.752 7f3a1694c948 [contrail-topology] [WARNING]: table 'obj_shared_table' fixed with properties {'gc_grace_seconds': 864000}
09/02/2024 02:02:11.761 7f3a1694c948 [contrail-topology] [WARNING]: Zookeeper lock released.
09/02/2024 02:02:11.762 7f3a1508cd48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-k8s-manifests-84-1.cluster.local  process_status = [ <<  module_id = contrail-topology  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.43:2181,  ]  status = Up  description =   >>, <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.43:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.43:9041,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart] connection down  >>,  ]  >>  
09/02/2024 02:02:11.789 7f3a1694c948 [contrail-topology] [ERROR]: Error in db walk read 'type'
09/02/2024 02:02:12.395 7f3a1508cd48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-k8s-manifests-84-1.cluster.local  process_status = [ <<  module_id = contrail-topology  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.43:2181,  ]  status = Up  description =   >>, <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.43:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.43:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.43:9041,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>