02/13/2025 02:08:33.036 7f19fb8fc630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-135-1.cluster.local process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 02/13/2025 02:08:33.036 7f19fb8fc630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-k8s-manifests-135-1.cluster.local:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1739412513036425 collector_name = collector_ip = collector_list = [ 10.0.0.29:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 02/13/2025 02:08:33.181 7f19fcc34148 [contrail-schema] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.29:5673//'] 02/13/2025 02:08:33.190 7f19fcc34148 [contrail-schema] [WARNING]: RabbitMQ drainer connection down 02/13/2025 02:08:33.191 7f19fb7430f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-135-1.cluster.local process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.29:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 02/13/2025 02:08:33.191 7f19fb7430f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-135-1.cluster.local process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.29:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 02/13/2025 02:08:33.221 7f19fcc34148 [contrail-schema] [WARNING]: RabbitMQ drainer connection ESTABLISHED 02/13/2025 02:08:33.221 7f19fb7430f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-135-1.cluster.local process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.29:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 02/13/2025 02:08:33.285 7f19fcc34148 [contrail-schema] [WARNING]: RabbitMQ publish connection down 02/13/2025 02:08:33.286 7f19fa72f240 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-135-1.cluster.local process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.29:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 02/13/2025 02:08:33.307 7f19fcc34148 [contrail-schema] [WARNING]: RabbitMQ publish connection ESTABLISHED 02/13/2025 02:08:33.307 7f19fa72f198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-135-1.cluster.local process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.29:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 02/13/2025 02:08:33.341 7f19fa74a048 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-135-1.cluster.local process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.29:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.29:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Zookeeper:Zookeeper[] connection down >>, ] >> 02/13/2025 02:08:33.356 7f19fcc34148 [contrail-schema] [WARNING]: Waiting to be elected as master... 02/13/2025 02:08:33.356 7f19face66d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-135-1.cluster.local process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.29:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.29:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 02/13/2025 02:08:33.366 7f19fcc34148 [contrail-schema] [WARNING]: Elected master Schema Transformer node. Initializing... 02/13/2025 02:08:33.394 7f19facfba20 [contrail-schema] [ERROR]: Cannot write http_port 8087 to /tmp/contrail-schema.0.http_port 02/13/2025 02:08:33.394 7f19facfba20 [contrail-schema] [ERROR]: Starting Introspect on HTTP Port 8087 02/13/2025 02:08:33.399 7f19facfbc18 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-135-1.cluster.local process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.29:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.29:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.29,:8082, ] status = Initializing description = ApiServer >>, ] description = Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[ApiServer] connection down >>, ] >> 02/13/2025 02:08:33.446 7f19fcc34148 [contrail-schema] [WARNING]: VNCCassandra started with driver cql 02/13/2025 02:08:33.446 7f19fcc34148 [contrail-schema] [WARNING]: initializing cassandra cluster 02/13/2025 02:08:33.447 7f19fcc34148 [contrail-schema] [WARNING]: CassandraDriverCQL.__init__Cluster before create 02/13/2025 02:08:33.461 7f19facfbd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-135-1.cluster.local process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.29:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.29:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.29,:8082, ] status = Up description = ApiServer >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 02/13/2025 02:08:33.461 7f19facfbd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-135-1.cluster.local process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.29:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.29:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.29,:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.29:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 02/13/2025 02:08:33.463 7f19fcc34148 [contrail-schema] [WARNING]: CassandraDriverCQL.__init__Cluster created 02/13/2025 02:08:33.564 7f19fcc34148 [contrail-schema] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 02/13/2025 02:08:33.566 7f19fa534438 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-135-1.cluster.local process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.29:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.29:2181, ] status = Initializing description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.29,:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.29:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Zookeeper:Zookeeper[], Database:Cassandra[] connection down >>, ] >> 02/13/2025 02:08:33.576 7f19fcc34148 [contrail-schema] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 02/13/2025 02:08:33.576 7f19fa4b02e8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-135-1.cluster.local process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.29:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.29:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.29,:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.29:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 02/13/2025 02:08:33.595 7f19fcc34148 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 02/13/2025 02:08:33.684 7f19fcc34148 [contrail-schema] [WARNING]: keyspace 'to_bgp_keyspace', created 02/13/2025 02:08:33.697 7f19fcc34148 [contrail-schema] [WARNING]: Zookeeper lock released. 02/13/2025 02:08:33.743 7f19fcc34148 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 02/13/2025 02:08:33.850 7f19fcc34148 [contrail-schema] [WARNING]: keyspace 'to_bgp_keyspace' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None} 02/13/2025 02:08:33.863 7f19fcc34148 [contrail-schema] [WARNING]: Zookeeper lock released. 02/13/2025 02:08:33.863 7f19fcc34148 [contrail-schema] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 02/13/2025 02:08:33.986 7f19fcc34148 [contrail-schema] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 02/13/2025 02:08:34.003 7f19fcc34148 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 02/13/2025 02:08:34.196 7f19fcc34148 [contrail-schema] [WARNING]: table 'route_target_table', created 02/13/2025 02:08:34.199 7f19fcc34148 [contrail-schema] [WARNING]: Zookeeper lock released. 02/13/2025 02:08:34.309 7f19fcc34148 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 02/13/2025 02:08:34.495 7f19fcc34148 [contrail-schema] [WARNING]: table 'route_target_table' fixed with properties {'gc_grace_seconds': 864000} 02/13/2025 02:08:34.500 7f19fcc34148 [contrail-schema] [WARNING]: Zookeeper lock released. 02/13/2025 02:08:34.589 7f19fcc34148 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 02/13/2025 02:08:34.924 7f19fcc34148 [contrail-schema] [WARNING]: table 'service_chain_ip_address_table', created 02/13/2025 02:08:34.931 7f19fcc34148 [contrail-schema] [WARNING]: Zookeeper lock released. 02/13/2025 02:08:35.118 7f19fcc34148 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 02/13/2025 02:08:35.233 7f19fcc34148 [contrail-schema] [WARNING]: table 'service_chain_ip_address_table' fixed with properties {'gc_grace_seconds': 864000} 02/13/2025 02:08:35.240 7f19fcc34148 [contrail-schema] [WARNING]: Zookeeper lock released. 02/13/2025 02:08:35.370 7f19fcc34148 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 02/13/2025 02:08:35.580 7f19fcc34148 [contrail-schema] [WARNING]: table 'service_chain_table', created 02/13/2025 02:08:35.594 7f19fcc34148 [contrail-schema] [WARNING]: Zookeeper lock released. 02/13/2025 02:08:35.759 7f19fcc34148 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 02/13/2025 02:08:35.882 7f19fcc34148 [contrail-schema] [WARNING]: table 'service_chain_table' fixed with properties {'gc_grace_seconds': 864000} 02/13/2025 02:08:35.885 7f19fcc34148 [contrail-schema] [WARNING]: Zookeeper lock released. 02/13/2025 02:08:36.046 7f19fcc34148 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 02/13/2025 02:08:36.240 7f19fcc34148 [contrail-schema] [WARNING]: table 'service_chain_uuid_table', created 02/13/2025 02:08:36.251 7f19fcc34148 [contrail-schema] [WARNING]: Zookeeper lock released. 02/13/2025 02:08:36.422 7f19fcc34148 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 02/13/2025 02:08:36.501 7f19fcc34148 [contrail-schema] [WARNING]: table 'service_chain_uuid_table' fixed with properties {'gc_grace_seconds': 864000} 02/13/2025 02:08:36.513 7f19fcc34148 [contrail-schema] [WARNING]: Zookeeper lock released. 02/13/2025 02:08:36.513 7f19fa466828 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-135-1.cluster.local process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.29:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.29:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.29,:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.29:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 02/13/2025 02:08:36.551 7f19fcc34148 [contrail-schema] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.29:5673//'] 02/13/2025 02:08:36.552 7f19fcc34148 [contrail-schema] [WARNING]: RabbitMQ drainer connection down 02/13/2025 02:08:36.552 7f19fa41a6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-135-1.cluster.local process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.29:5673, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.29:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.29,:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.29:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 02/13/2025 02:08:36.556 7f19fa41a6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-135-1.cluster.local process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.29:5673, ] status = Down description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.29:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.29,:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.29:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 02/13/2025 02:08:36.570 7f19fcc34148 [contrail-schema] [WARNING]: RabbitMQ drainer connection ESTABLISHED 02/13/2025 02:08:36.575 7f19fa41b438 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-135-1.cluster.local process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.29:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.29:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.29,:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.29:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 02/13/2025 02:08:36.600 7f19fcc34148 [contrail-schema] [WARNING]: RabbitMQ publish connection down 02/13/2025 02:08:36.601 7f19fa3fd828 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-135-1.cluster.local process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.29:5673, ] status = Down description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.29:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.29,:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.29:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 02/13/2025 02:08:36.635 7f19fcc34148 [contrail-schema] [WARNING]: RabbitMQ publish connection ESTABLISHED 02/13/2025 02:08:36.636 7f19fa4b00f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-135-1.cluster.local process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.29:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.29:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.29,:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.29:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 02/13/2025 02:08:36.640 7f19facef198 [contrail-schema] [WARNING]: RabbitMQ publish connection down 02/13/2025 02:08:36.641 7f19fa3fdf60 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-135-1.cluster.local process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.29:5673, ] status = Down description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.29:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.29,:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.29:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 02/13/2025 02:08:36.700 7f19facef198 [contrail-schema] [WARNING]: RabbitMQ publish connection ESTABLISHED 02/13/2025 02:08:36.703 7f19fa407d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-135-1.cluster.local process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.29:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.29:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.29,:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.29:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 02/13/2025 02:08:37.041 7f19fd9770f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-k8s-manifests-135-1.cluster.local process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.29:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.29:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.29,:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.29:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/13/2025 02:08:40.316 7f19fcc34148 [contrail-schema] [WARNING]: Virtual-Network Evaluate Complete: VN Name (default-domain:default-project:__link_local__): Duration (0.000) sec 02/13/2025 02:08:40.316 7f19fcc34148 [contrail-schema] [WARNING]: Virtual-Network Evaluate Complete: VN Name (default-domain:default-project:dci-network): Duration (0.000) sec 02/13/2025 02:08:40.316 7f19fcc34148 [contrail-schema] [WARNING]: Virtual-Network Evaluate Complete: VN Name (default-domain:default-project:default-virtual-network): Duration (0.000) sec 02/13/2025 02:08:40.316 7f19fcc34148 [contrail-schema] [WARNING]: Network Policy Evaluate Complete: VN Name (default-domain:default-project:ip-fabric), Policy Name (default-domain:k8s-default:k8s-default-ip-fabric-np): Duration (0.000) sec 02/13/2025 02:08:40.429 7f19fcc34148 [contrail-schema] [WARNING]: Virtual-Network Evaluate Complete: VN Name (default-domain:default-project:ip-fabric): Duration (0.112) sec 02/13/2025 02:08:40.429 7f19fcc34148 [contrail-schema] [WARNING]: Network Policy Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-pod-network), Policy Name (default-domain:k8s-default:k8s-default-service-np): Duration (0.000) sec 02/13/2025 02:08:40.429 7f19fcc34148 [contrail-schema] [WARNING]: Network Policy Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-pod-network), Policy Name (default-domain:k8s-default:k8s-default-ip-fabric-np): Duration (0.000) sec 02/13/2025 02:08:40.429 7f19fcc34148 [contrail-schema] [WARNING]: Network Policy Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-pod-network), Policy Name (default-domain:k8s-default:k8s-default-pod-service-np): Duration (0.000) sec 02/13/2025 02:08:40.671 7f19fcc34148 [contrail-schema] [WARNING]: Virtual-Network Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-pod-network): Duration (0.243) sec 02/13/2025 02:08:40.672 7f19fcc34148 [contrail-schema] [WARNING]: Network Policy Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-service-network), Policy Name (default-domain:k8s-default:k8s-default-service-np): Duration (0.000) sec 02/13/2025 02:08:40.672 7f19fcc34148 [contrail-schema] [WARNING]: Network Policy Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-service-network), Policy Name (default-domain:k8s-default:k8s-default-ip-fabric-np): Duration (0.000) sec 02/13/2025 02:08:40.672 7f19fcc34148 [contrail-schema] [WARNING]: Network Policy Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-service-network), Policy Name (default-domain:k8s-default:k8s-default-pod-service-np): Duration (0.000) sec 02/13/2025 02:08:41.026 7f19fcc34148 [contrail-schema] [WARNING]: Virtual-Network Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-service-network): Duration (0.354) sec 02/13/2025 02:08:42.025 7f19fa4018d0 [contrail-schema] [WARNING]: Network Policy Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-service-network), Policy Name (default-domain:k8s-default:k8s-default-service-np): Duration (0.000) sec 02/13/2025 02:08:42.025 7f19fa4018d0 [contrail-schema] [WARNING]: Network Policy Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-service-network), Policy Name (default-domain:k8s-default:k8s-default-ip-fabric-np): Duration (0.000) sec 02/13/2025 02:08:42.025 7f19fa4018d0 [contrail-schema] [WARNING]: Network Policy Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-service-network), Policy Name (default-domain:k8s-default:k8s-default-pod-service-np): Duration (0.000) sec 02/13/2025 02:08:42.086 7f19fa4018d0 [contrail-schema] [WARNING]: Virtual-Network Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-service-network): Duration (0.062) sec 02/13/2025 02:08:42.102 7f19fa4018d0 [contrail-schema] [WARNING]: Network Policy Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-service-network), Policy Name (default-domain:k8s-default:k8s-default-service-np): Duration (0.000) sec 02/13/2025 02:08:42.102 7f19fa4018d0 [contrail-schema] [WARNING]: Network Policy Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-service-network), Policy Name (default-domain:k8s-default:k8s-default-ip-fabric-np): Duration (0.000) sec 02/13/2025 02:08:42.102 7f19fa4018d0 [contrail-schema] [WARNING]: Network Policy Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-service-network), Policy Name (default-domain:k8s-default:k8s-default-pod-service-np): Duration (0.000) sec 02/13/2025 02:08:42.103 7f19fa4018d0 [contrail-schema] [WARNING]: Virtual-Network Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-service-network): Duration (0.001) sec 02/13/2025 02:08:52.332 7f19fa4018d0 [contrail-schema] [WARNING]: Network Policy Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-pod-network), Policy Name (default-domain:k8s-default:k8s-default-service-np): Duration (0.000) sec 02/13/2025 02:08:52.332 7f19fa4018d0 [contrail-schema] [WARNING]: Network Policy Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-pod-network), Policy Name (default-domain:k8s-default:k8s-default-ip-fabric-np): Duration (0.000) sec 02/13/2025 02:08:52.333 7f19fa4018d0 [contrail-schema] [WARNING]: Network Policy Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-pod-network), Policy Name (default-domain:k8s-default:k8s-default-pod-service-np): Duration (0.000) sec 02/13/2025 02:08:52.436 7f19fa4018d0 [contrail-schema] [WARNING]: Virtual-Network Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-pod-network): Duration (0.104) sec 02/13/2025 02:08:52.674 7f19fa4018d0 [contrail-schema] [WARNING]: Network Policy Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-pod-network), Policy Name (default-domain:k8s-default:k8s-default-service-np): Duration (0.000) sec 02/13/2025 02:08:52.674 7f19fa4018d0 [contrail-schema] [WARNING]: Network Policy Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-pod-network), Policy Name (default-domain:k8s-default:k8s-default-ip-fabric-np): Duration (0.000) sec 02/13/2025 02:08:52.674 7f19fa4018d0 [contrail-schema] [WARNING]: Network Policy Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-pod-network), Policy Name (default-domain:k8s-default:k8s-default-pod-service-np): Duration (0.000) sec 02/13/2025 02:08:52.675 7f19fa4018d0 [contrail-schema] [WARNING]: Virtual-Network Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-pod-network): Duration (0.001) sec 02/13/2025 02:08:53.850 7f19fa4018d0 [contrail-schema] [WARNING]: Network Policy Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-pod-network), Policy Name (default-domain:k8s-default:k8s-default-service-np): Duration (0.000) sec 02/13/2025 02:08:53.855 7f19fa4018d0 [contrail-schema] [WARNING]: Network Policy Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-pod-network), Policy Name (default-domain:k8s-default:k8s-default-ip-fabric-np): Duration (0.000) sec 02/13/2025 02:08:53.856 7f19fa4018d0 [contrail-schema] [WARNING]: Network Policy Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-pod-network), Policy Name (default-domain:k8s-default:k8s-default-pod-service-np): Duration (0.000) sec 02/13/2025 02:08:53.857 7f19fa4018d0 [contrail-schema] [WARNING]: Virtual-Network Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-pod-network): Duration (0.007) sec 02/13/2025 02:08:53.888 7f19fa4018d0 [contrail-schema] [WARNING]: Network Policy Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-pod-network), Policy Name (default-domain:k8s-default:k8s-default-service-np): Duration (0.000) sec 02/13/2025 02:08:53.889 7f19fa4018d0 [contrail-schema] [WARNING]: Network Policy Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-pod-network), Policy Name (default-domain:k8s-default:k8s-default-ip-fabric-np): Duration (0.000) sec 02/13/2025 02:08:53.889 7f19fa4018d0 [contrail-schema] [WARNING]: Network Policy Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-pod-network), Policy Name (default-domain:k8s-default:k8s-default-pod-service-np): Duration (0.000) sec 02/13/2025 02:08:53.890 7f19fa4018d0 [contrail-schema] [WARNING]: Virtual-Network Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-pod-network): Duration (0.001) sec 02/13/2025 02:08:54.090 7f19fa4018d0 [contrail-schema] [WARNING]: Network Policy Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-pod-network), Policy Name (default-domain:k8s-default:k8s-default-service-np): Duration (0.000) sec 02/13/2025 02:08:54.091 7f19fa4018d0 [contrail-schema] [WARNING]: Network Policy Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-pod-network), Policy Name (default-domain:k8s-default:k8s-default-ip-fabric-np): Duration (0.000) sec 02/13/2025 02:08:54.091 7f19fa4018d0 [contrail-schema] [WARNING]: Network Policy Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-pod-network), Policy Name (default-domain:k8s-default:k8s-default-pod-service-np): Duration (0.000) sec 02/13/2025 02:08:54.091 7f19fa4018d0 [contrail-schema] [WARNING]: Virtual-Network Evaluate Complete: VN Name (default-domain:k8s-default:k8s-default-pod-network): Duration (0.001) sec