01/09/2025 02:17:08.632 7fc0edffcf48 [contrail-topology] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 01/09/2025 02:17:08.632 7fc0edffcf48 [contrail-topology] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 01/09/2025 02:17:08.632 7fc0edffcf48 [contrail-topology] [INFO]: SANDESH: Flow Logging: [None] -> [False] 01/09/2025 02:17:08.633 7fc0edffcf48 [contrail-topology] [DEBUG]: Add uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:17:08.634 7fc0edffcf48 [contrail-topology] [INFO]: Consistent scheduler zk start 01/09/2025 02:17:08.635 7fc0eb391198 [contrail-topology] [ERROR]: Cannot write http_port 5921 to /tmp/contrail-topology.0.http_port 01/09/2025 02:17:08.635 7fc0eb391198 [contrail-topology] [ERROR]: Starting Introspect on HTTP Port 5921 01/09/2025 02:17:08.635 7fc0eb393ac8 [contrail-topology] [INFO]: Processing event[EvStart] in state[none] 01/09/2025 02:17:08.636 7fc0eb393ac8 [contrail-topology] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/09/2025 02:17:08.636 7fc0eb393ac8 [contrail-topology] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 01/09/2025 02:17:08.636 7fc0eb393ac8 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:08.636 7fc0eb393ac8 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, ] description = Zookeeper:Zookeeper[Connection to Zookeeper initialized] connection down >>, ] >> 01/09/2025 02:17:08.637 7fc0eb393ac8 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:08.637 7fc0eb393ac8 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:08.637 7fc0eb393ac8 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Zookeeper:Zookeeper[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/09/2025 02:17:08.637 7fc0eb393ac8 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:08.637 7fc0eb393ac8 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:08.637 7fc0eb393ac8 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-463-1:AnalyticsSNMP:contrail-topology:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 5921 start_time = 1736389028636457 collector_name = collector_ip = collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 2 >> 01/09/2025 02:17:08.637 7fc0eb393ac8 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:08.647 7fc0e8ff7390 [contrail-topology] [INFO]: Consistent scheduler listen CONNECTED 01/09/2025 02:17:08.648 7fc0e8ff7ac8 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:08.648 7fc0e8ff7ac8 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/09/2025 02:17:08.648 7fc0e8ff7ac8 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:08.894 7fc0e8fd8f60 [contrail-topology] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.30:5673//'] 01/09/2025 02:17:08.907 7fc0e8fd8f60 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:08.908 7fc0ea69c588 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:08.908 7fc0ea69c588 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/09/2025 02:17:08.908 7fc0ea69c588 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:08.908 7fc0ea69c588 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:08.908 7fc0ea69c588 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/09/2025 02:17:08.909 7fc0ea69c588 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:08.924 7fc0e8fd3240 [contrail-topology] [DEBUG]: Waiting for allocation... 01/09/2025 02:17:08.927 7fc0e8fd8f60 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:08.927 7fc0e8fd3a20 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:08.928 7fc0e8fd3a20 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/09/2025 02:17:08.928 7fc0e8fd3a20 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:08.944 7fc0e8fd8f60 [contrail-topology] [WARNING]: RabbitMQ publish connection down 01/09/2025 02:17:08.944 7fc0e8fddf60 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:08.945 7fc0e8fddf60 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/09/2025 02:17:08.945 7fc0e8fddf60 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:08.960 7fc0e8fd8f60 [contrail-topology] [WARNING]: RabbitMQ publish connection ESTABLISHED 01/09/2025 02:17:08.960 7fc0e8ff7f60 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:08.961 7fc0e8ff7f60 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/09/2025 02:17:08.961 7fc0e8ff7f60 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:08.961 7fc0e8fd8f60 [contrail-topology] [WARNING]: VNCCassandra started with driver cql 01/09/2025 02:17:08.962 7fc0e8fd8f60 [contrail-topology] [WARNING]: initializing cassandra cluster 01/09/2025 02:17:08.963 7fc0e8fd8f60 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster before create 01/09/2025 02:17:08.963 7fc0e8ff7f60 [contrail-topology] [WARNING]: RabbitMQ publish connection down 01/09/2025 02:17:08.963 7fc0e8fd8048 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:08.964 7fc0e8fd8048 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 01/09/2025 02:17:08.964 7fc0e8fd8048 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:08.964 7fc0e8fd8048 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:08.964 7fc0e8fd8048 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[], Database:Cassandra[] connection down >>, ] >> 01/09/2025 02:17:08.964 7fc0e8fd8048 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:08.965 7fc0e8fd8f60 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster created 01/09/2025 02:17:08.987 7fc0e8ff7f60 [contrail-topology] [WARNING]: RabbitMQ publish connection ESTABLISHED 01/09/2025 02:17:08.988 7fc0ecc27780 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:08.988 7fc0ecc27780 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 01/09/2025 02:17:08.988 7fc0ecc27780 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:09.034 7fc0e8fd8f60 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 01/09/2025 02:17:09.036 7fc0e9f29828 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:09.036 7fc0e9f29828 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 01/09/2025 02:17:09.036 7fc0e9f29828 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:09.042 7fc0e8fd8f60 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 01/09/2025 02:17:09.042 7fc0e9f2e588 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:09.042 7fc0e9f2e588 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 01/09/2025 02:17:09.042 7fc0e9f2e588 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:09.054 7fc0e8fd8f60 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 01/09/2025 02:17:09.095 7fc0e8fd8f60 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 01/09/2025 02:17:09.096 7fc0e9ffc240 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:09.097 7fc0e9ffc240 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/09/2025 02:17:09.097 7fc0e9ffc240 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:11.135 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-900efd8e-b53a-4f84-bd81-cd935f14a61e', 'type': 'global_vrouter_config', 'uuid': '4a40060c-f8a7-4fc8-871a-34ecadf59cde'} 01/09/2025 02:17:11.136 7fc0e8fdd4e0 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/09/2025 02:17:11.136 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:11.137 7fc0ea01d2e8 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:11.139 7fc0ea01d2e8 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/09/2025 02:17:11.139 7fc0ea01d2e8 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:11.159 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:11.160 7fc0ee052828 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:11.160 7fc0ee052828 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/09/2025 02:17:11.160 7fc0ee052828 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:12.126 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements', 'operand2': {'json_value': '1'}, 'operation': 'size=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-conf-elements-inconsistency', 'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'id_perms': {'created': '2025-01-09T02:17:12.114543', 'creator': None, 'description': 'ContrailConfig has a list of ' 'elements - it should be a dict. ' 'Controllers have inconsistency in ' 'their data.', 'enable': True, 'last_modified': '2025-01-09T02:17:12.114543', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10144161239169123680, 'uuid_mslong': 313124488317848523}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '04587110-28a9-4bcb-8cc7-4ce6a4f64560', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-e27cea6a-806f-4288-aa08-5708b4ee9e85', 'type': 'alarm', 'uuid': '04587110-28a9-4bcb-8cc7-4ce6a4f64560'} 01/09/2025 02:17:12.128 7fc0e8fdd4e0 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/09/2025 02:17:12.128 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:12.128 7fc0e9f40eb8 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:12.128 7fc0e9f40eb8 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/09/2025 02:17:12.128 7fc0e9f40eb8 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:12.174 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:12.175 7fc0e9ffc978 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:12.175 7fc0e9ffc978 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/09/2025 02:17:12.175 7fc0e9ffc978 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:12.183 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_ip_address', 'operand2': {'uve_attribute': 'VrouterAgent.control_ip'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-address-mismatch-compute', 'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'id_perms': {'created': '2025-01-09T02:17:12.170618', 'creator': None, 'description': 'Compute Node IP Address mismatch.', 'enable': True, 'last_modified': '2025-01-09T02:17:12.170618', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11145790477383148361, 'uuid_mslong': 8940988019897880403}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7c14c53b-9309-4f53-9aad-cd62e15aa349', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-e7a75405-7b72-4dd2-b3de-e2cdbe32b36f', 'type': 'alarm', 'uuid': '7c14c53b-9309-4f53-9aad-cd62e15aa349'} 01/09/2025 02:17:12.184 7fc0e8fdd4e0 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/09/2025 02:17:12.184 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:12.185 7fc0e9ffce10 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:12.185 7fc0e9ffce10 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/09/2025 02:17:12.185 7fc0e9ffce10 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:12.214 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:12.214 7fc0e9ffc4e0 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:12.215 7fc0e9ffc4e0 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/09/2025 02:17:12.215 7fc0e9ffc4e0 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:12.264 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.bgp_router_parameters.address', 'operand2': {'uve_attribute': 'BgpRouterState.bgp_router_ip_list'}, 'operation': 'not ' 'in'}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-address-mismatch-control', 'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'id_perms': {'created': '2025-01-09T02:17:12.254846', 'creator': None, 'description': 'Control Node IP Address mismatch.', 'enable': True, 'last_modified': '2025-01-09T02:17:12.254846', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13826826152815730930, 'uuid_mslong': 16287791566759347631}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e209dc22-304b-45af-bfe2-c120d9a9a0f2', 'uve_keys': {'uve_key': ['control-node']}}, 'oper': 'CREATE', 'request-id': 'req-e76944fa-39d3-4ede-90d5-3047ff64f9f1', 'type': 'alarm', 'uuid': 'e209dc22-304b-45af-bfe2-c120d9a9a0f2'} 01/09/2025 02:17:12.265 7fc0e8fdd4e0 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/09/2025 02:17:12.265 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:12.265 7fc0ee052828 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:12.266 7fc0ee052828 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/09/2025 02:17:12.266 7fc0ee052828 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:12.287 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:12.288 7fc0eb87e4e0 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:12.289 7fc0eb87e4e0 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/09/2025 02:17:12.289 7fc0eb87e4e0 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:12.343 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'BgpRouterState.num_up_bgp_peer', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'BgpRouterState.num_up_bgp_peer', 'operand2': {'uve_attribute': 'BgpRouterState.num_bgp_peer'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-bgp-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'id_perms': {'created': '2025-01-09T02:17:12.329894', 'creator': None, 'description': 'BGP peer mismatch. Not enough BGP ' 'peers are up.', 'enable': True, 'last_modified': '2025-01-09T02:17:12.329894', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11350981090377236271, 'uuid_mslong': 1661040740873358980}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '170d33c0-d535-4e84-9d86-c929601c7f2f', 'uve_keys': {'uve_key': ['control-node']}}, 'oper': 'CREATE', 'request-id': 'req-666da6f4-f445-4f0b-8aef-680d9a857583', 'type': 'alarm', 'uuid': '170d33c0-d535-4e84-9d86-c929601c7f2f'} 01/09/2025 02:17:12.343 7fc0e8fdd4e0 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/09/2025 02:17:12.343 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:12.344 7fc0e708bcc0 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:12.344 7fc0e708bcc0 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/09/2025 02:17:12.344 7fc0e708bcc0 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:12.378 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:12.378 7fc0e9fee390 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:12.378 7fc0e9fee390 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/09/2025 02:17:12.378 7fc0e9fee390 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:12.418 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-conf-incorrect', 'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'id_perms': {'created': '2025-01-09T02:17:12.410257', 'creator': None, 'description': 'ContrailConfig missing or ' 'incorrect. Configuration pushed to ' 'Ifmap as ContrailConfig is ' 'missing/incorrect.', 'enable': True, 'last_modified': '2025-01-09T02:17:12.410257', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9505299973895413062, 'uuid_mslong': 627925215918902660}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '08b6d6a8-305b-4d84-83e9-9bf70b90dd46', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-1c5d9a01-5789-4f11-a076-4f455c13e99e', 'type': 'alarm', 'uuid': '08b6d6a8-305b-4d84-83e9-9bf70b90dd46'} 01/09/2025 02:17:12.420 7fc0e8fdd4e0 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/09/2025 02:17:12.420 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:12.421 7fc0e9f40e10 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:12.421 7fc0e9f40e10 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/09/2025 02:17:12.421 7fc0e9f40e10 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:12.446 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:12.447 7fc0e9ffc240 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:12.447 7fc0e9ffc240 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/09/2025 02:17:12.447 7fc0e9ffc240 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:12.490 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.disk_usage_info.*.percentage_partition_space_used', 'operand2': {'json_value': '[70, ' '90]'}, 'operation': 'range', 'variables': ['NodeStatus.disk_usage_info.__key']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-disk-usage-high', 'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'id_perms': {'created': '2025-01-09T02:17:12.481113', 'creator': None, 'description': 'Disk usage crosses high threshold ' 'limit.', 'enable': True, 'last_modified': '2025-01-09T02:17:12.481113', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12031027536832510908, 'uuid_mslong': 2505912867882682713}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '22c6ca79-f83a-4959-a6f6-cbcd37d83bbc', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-0c8df78f-abf2-4611-8358-e07626627c51', 'type': 'alarm', 'uuid': '22c6ca79-f83a-4959-a6f6-cbcd37d83bbc'} 01/09/2025 02:17:12.490 7fc0e8fdd4e0 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/09/2025 02:17:12.492 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:12.492 7fc0e9fee048 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:12.493 7fc0e9fee048 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/09/2025 02:17:12.493 7fc0e9fee048 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:12.513 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:12.513 7fc0e9feec18 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:12.513 7fc0e9feec18 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/09/2025 02:17:12.513 7fc0e9feec18 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:12.569 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.disk_usage_info.*.percentage_partition_space_used', 'operand2': {'json_value': '90'}, 'operation': '>', 'variables': ['NodeStatus.disk_usage_info.__key']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-disk-usage-critical', 'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'id_perms': {'created': '2025-01-09T02:17:12.559732', 'creator': None, 'description': 'Disk usage crosses critical ' 'threshold limit.', 'enable': True, 'last_modified': '2025-01-09T02:17:12.559732', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12910193470155528731, 'uuid_mslong': 7334522386921113838}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '65c97540-3d95-48ee-b32a-388f5a301a1b', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-ecf39fde-cc25-41e5-9e29-a19f26e0992d', 'type': 'alarm', 'uuid': '65c97540-3d95-48ee-b32a-388f5a301a1b'} 01/09/2025 02:17:12.570 7fc0e8fdd4e0 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/09/2025 02:17:12.570 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:12.570 7fc0e9feeac8 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:12.570 7fc0e9feeac8 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/09/2025 02:17:12.570 7fc0e9feeac8 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:12.593 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:12.594 7fc0e9fe8240 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:12.594 7fc0e9fe8240 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/09/2025 02:17:12.594 7fc0e9fe8240 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:12.637 7fc0e9fe8b70 [contrail-topology] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/09/2025 02:17:12.644 7fc0e9fe8b70 [contrail-topology] [INFO]: Session Event: TCP Connected 01/09/2025 02:17:12.647 7fc0e9fe8b70 [contrail-topology] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/09/2025 02:17:12.647 7fc0e9fe8b70 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/09/2025 02:17:12.647 7fc0e9fe8b70 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/09/2025 02:17:12.647 7fc0e9fe8b70 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/09/2025 02:17:12.647 7fc0e9fe8b70 [contrail-topology] [INFO]: Processing event[EvTcpConnected] in state[Connect] 01/09/2025 02:17:12.648 7fc0e9fe8b70 [contrail-topology] [DEBUG]: Send sandesh control message. uve type count # 5 01/09/2025 02:17:12.648 7fc0e9fe8b70 [contrail-topology] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 01/09/2025 02:17:12.648 7fc0e9fe8b70 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/09/2025 02:17:12.648 7fc0e9fe8b70 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/09/2025 02:17:12.649 7fc0e9c026d8 [contrail-topology] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/09/2025 02:17:12.650 7fc0e9c026d8 [contrail-topology] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/09/2025 02:17:12.652 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-node-status', 'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'id_perms': {'created': '2025-01-09T02:17:12.637888', 'creator': None, 'description': 'Node Failure. NodeStatus UVE not ' 'present.', 'enable': True, 'last_modified': '2025-01-09T02:17:12.637888', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10987962032868071135, 'uuid_mslong': 16529525856212109930}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e564ac30-6528-4a6a-987d-15408e9496df', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-19fd6799-1dfa-4dbd-a8d9-4c480f60d700', 'type': 'alarm', 'uuid': 'e564ac30-6528-4a6a-987d-15408e9496df'} 01/09/2025 02:17:12.652 7fc0e8fdd4e0 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/09/2025 02:17:12.652 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:12.652 7fc0e9fe8390 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/09/2025 02:17:12.672 7fc0e9c02588 [contrail-topology] [DEBUG]: Extracted sandesh length: 0000001012 01/09/2025 02:17:12.672 7fc0e9c02588 [contrail-topology] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/09/2025 02:17:12.673 7fc0e8ff7a20 [contrail-topology] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 01/09/2025 02:17:12.673 7fc0e8ff7a20 [contrail-topology] [DEBUG]: Number of uve types in sandesh control message is 0 01/09/2025 02:17:12.673 7fc0e8ff7a20 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:17:12.673 7fc0e8ff7a20 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/09/2025 02:17:12.673 7fc0e8ff7a20 [contrail-topology] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 01/09/2025 02:17:12.674 7fc0e9feea20 [contrail-topology] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/09/2025 02:17:12.675 7fc0e9feea20 [contrail-topology] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/09/2025 02:17:12.681 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:12.724 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.build_info', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-partial-sysinfo', 'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'id_perms': {'created': '2025-01-09T02:17:12.712252', 'creator': None, 'description': 'System Info Incomplete.', 'enable': True, 'last_modified': '2025-01-09T02:17:12.712252', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9290584443843798029, 'uuid_mslong': 7528790807798891143}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '687ba359-b714-4287-80ee-c953fb14640d', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-d7b16edf-0d37-4628-b616-9db5cfcd852b', 'type': 'alarm', 'uuid': '687ba359-b714-4287-80ee-c953fb14640d'} 01/09/2025 02:17:12.725 7fc0e8fdd4e0 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/09/2025 02:17:12.725 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:12.759 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:12.798 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.process_status', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'NodeStatus.process_status.state', 'operand2': {'json_value': '"Functional"'}, 'operation': '!=', 'variables': ['NodeStatus.process_status.module_id', 'NodeStatus.process_status.instance_id']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-process-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'id_perms': {'created': '2025-01-09T02:17:12.789664', 'creator': None, 'description': 'Process(es) reporting as ' 'non-functional.', 'enable': True, 'last_modified': '2025-01-09T02:17:12.789664', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13468799295902584398, 'uuid_mslong': 2654152975275149313}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '24d57211-96d2-4801-baea-c9994f4e0e4e', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-7d7848d6-d57f-4c41-837d-d0974d4e0bb7', 'type': 'alarm', 'uuid': '24d57211-96d2-4801-baea-c9994f4e0e4e'} 01/09/2025 02:17:12.798 7fc0e8fdd4e0 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/09/2025 02:17:12.798 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:12.851 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:12.874 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.process_info', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'NodeStatus.process_info.process_state', 'operand2': {'json_value': '"PROCESS_STATE_RUNNING"'}, 'operation': '!=', 'variables': ['NodeStatus.process_info.process_name']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-process-status', 'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'id_perms': {'created': '2025-01-09T02:17:12.861196', 'creator': None, 'description': 'Process Failure.', 'enable': True, 'last_modified': '2025-01-09T02:17:12.861196', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11966246762247803243, 'uuid_mslong': 10630822936088235493}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '93884522-c79d-4de5-a610-a607c672d16b', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-5488cc4b-4a31-484f-b3a3-e1fd44333940', 'type': 'alarm', 'uuid': '93884522-c79d-4de5-a610-a607c672d16b'} 01/09/2025 02:17:12.874 7fc0e8fdd4e0 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/09/2025 02:17:12.874 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:12.914 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:12.944 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_refs', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'ProuterData.connected_agent_list', 'operand2': {'json_value': '1'}, 'operation': 'size!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-prouter-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'id_perms': {'created': '2025-01-09T02:17:12.933802', 'creator': None, 'description': 'Prouter connectivity to controlling ' 'tor agent does not exist we look ' 'for non-empty value for ' 'connected_agent_list', 'enable': True, 'last_modified': '2025-01-09T02:17:12.933802', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10426646850355048131, 'uuid_mslong': 2060276888057105997}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1c9792e9-f397-4e4d-90b2-e41151dbaec3', 'uve_keys': {'uve_key': ['prouter']}}, 'oper': 'CREATE', 'request-id': 'req-619807ee-9f7d-495f-8584-96013676097d', 'type': 'alarm', 'uuid': '1c9792e9-f397-4e4d-90b2-e41151dbaec3'} 01/09/2025 02:17:12.944 7fc0e8fdd4e0 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/09/2025 02:17:12.945 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:12.972 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:13.059 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_refs', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'ProuterData.tsn_agent_list', 'operand2': {'json_value': '1'}, 'operation': 'size!='}, {'operand1': 'ProuterData.gateway_mode', 'operand2': {'json_value': '"SERVER"'}, 'operation': '!='}]}, {'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_refs', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'ProuterData.tsn_agent_list', 'operand2': {'json_value': '0'}, 'operation': 'size!='}, {'operand1': 'ProuterData.gateway_mode', 'operand2': {'json_value': '"SERVER"'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-prouter-tsn-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'id_perms': {'created': '2025-01-09T02:17:13.003949', 'creator': None, 'description': 'Prouter connectivity to controlling ' 'tsn agent does not exist we look ' 'for non-empty value for ' 'tsn_agent_list', 'enable': True, 'last_modified': '2025-01-09T02:17:13.003949', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13819648541707433070, 'uuid_mslong': 11473313970520211666}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9f396644-9962-40d2-bfc9-41210937746e', 'uve_keys': {'uve_key': ['prouter']}}, 'oper': 'CREATE', 'request-id': 'req-9540a96e-a1f3-4874-856b-0e3d5aa4548c', 'type': 'alarm', 'uuid': '9f396644-9962-40d2-bfc9-41210937746e'} 01/09/2025 02:17:13.059 7fc0e8fdd4e0 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/09/2025 02:17:13.060 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:13.085 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:13.127 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'StorageCluster.info_stats.status', 'operand2': {'json_value': '0'}, 'operation': '!=', 'variables': ['StorageCluster.info_stats.health_summary']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-storage-cluster-state', 'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'id_perms': {'created': '2025-01-09T02:17:13.115609', 'creator': None, 'description': 'Storage Cluster warning/errors.', 'enable': True, 'last_modified': '2025-01-09T02:17:13.115609', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12426507443137976189, 'uuid_mslong': 16607624161691125557}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e67a222f-20cb-4735-ac73-d2ae5afc977d', 'uve_keys': {'uve_key': ['storage-cluster']}}, 'oper': 'CREATE', 'request-id': 'req-e6962bba-f645-4d58-b78d-b4c8a6268170', 'type': 'alarm', 'uuid': 'e67a222f-20cb-4735-ac73-d2ae5afc977d'} 01/09/2025 02:17:13.128 7fc0e8fdd4e0 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/09/2025 02:17:13.128 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:13.144 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:13.193 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.down_interface_count', 'operand2': {'json_value': '1'}, 'operation': '>=', 'variables': ['VrouterAgent.error_intf_list', 'VrouterAgent.no_config_intf_list']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-vrouter-interface', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'id_perms': {'created': '2025-01-09T02:17:13.185291', 'creator': None, 'description': 'Vrouter interface(s) down.', 'enable': True, 'last_modified': '2025-01-09T02:17:13.185291', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13413013484027878463, 'uuid_mslong': 14133036282239535946}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c422a19e-6098-4b4a-ba24-98b2d3019c3f', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-e20bea53-86a1-4f34-98ce-bbc12e7bdb9f', 'type': 'alarm', 'uuid': 'c422a19e-6098-4b4a-ba24-98b2d3019c3f'} 01/09/2025 02:17:13.194 7fc0e8fdd4e0 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/09/2025 02:17:13.194 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:13.225 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:13.268 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'BgpRouterState.num_up_xmpp_peer', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'BgpRouterState.num_up_xmpp_peer', 'operand2': {'uve_attribute': 'BgpRouterState.num_xmpp_peer'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-xmpp-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'id_perms': {'created': '2025-01-09T02:17:13.257441', 'creator': None, 'description': 'XMPP peer mismatch.', 'enable': True, 'last_modified': '2025-01-09T02:17:13.257441', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12560468853806998600, 'uuid_mslong': 2990091319901114299}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '297ef036-98af-4fbb-ae4f-bfdfd3862448', 'uve_keys': {'uve_key': ['control-node']}}, 'oper': 'CREATE', 'request-id': 'req-db41e7eb-2586-40e9-b7b4-93c6d580deaa', 'type': 'alarm', 'uuid': '297ef036-98af-4fbb-ae4f-bfdfd3862448'} 01/09/2025 02:17:13.268 7fc0e8fdd4e0 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/09/2025 02:17:13.268 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:13.298 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:13.336 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'XmppPeerInfoData.close_reason', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'XmppPeerInfoData.state_info.state', 'operand2': {'json_value': '"Established"'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-xmpp-close-reason', 'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'id_perms': {'created': '2025-01-09T02:17:13.325662', 'creator': None, 'description': 'XMPP connection closed towards ' 'peer, ' 'alarm has close reason', 'enable': True, 'last_modified': '2025-01-09T02:17:13.325662', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10743058213502208515, 'uuid_mslong': 2950341665036911144}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '28f1b81c-de8f-4228-9517-0286a9244a03', 'uve_keys': {'uve_key': ['xmpp-peer']}}, 'oper': 'CREATE', 'request-id': 'req-f6001a46-5e3e-4ccb-9b55-a4d633c409b0', 'type': 'alarm', 'uuid': '28f1b81c-de8f-4228-9517-0286a9244a03'} 01/09/2025 02:17:13.337 7fc0e8fdd4e0 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/09/2025 02:17:13.337 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:13.360 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:13.406 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.all_core_file_list', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'NodeStatus.all_core_file_list', 'operand2': {'json_value': '0'}, 'operation': 'size!='}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-core-files', 'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'id_perms': {'created': '2025-01-09T02:17:13.396725', 'creator': None, 'description': 'A core file has been generated on ' 'the node.', 'enable': True, 'last_modified': '2025-01-09T02:17:13.396725', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13028234261701715960, 'uuid_mslong': 4585284688803217494}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3fa23421-6e27-4056-b4cd-9608d34de7f8', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-997f7227-54b1-48d8-9195-5ae011a0b5d1', 'type': 'alarm', 'uuid': '3fa23421-6e27-4056-b4cd-9608d34de7f8'} 01/09/2025 02:17:13.406 7fc0e8fdd4e0 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/09/2025 02:17:13.406 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:13.428 7fc0e9f402e8 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:17:13.451 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:13.491 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks', 'operand2': {'json_value': '300'}, 'operation': '>='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-pending-cassandra-compaction-tasks', 'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'id_perms': {'created': '2025-01-09T02:17:13.480947', 'creator': None, 'description': 'Pending compaction tasks in ' 'cassandra crossed the configured ' 'threshold.', 'enable': True, 'last_modified': '2025-01-09T02:17:13.480947', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13336613675459094834, 'uuid_mslong': 7583069290198222620}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '693c7957-b570-471c-b915-2b7a385b2932', 'uve_keys': {'uve_key': ['database-nodeconfig-database-node']}}, 'oper': 'CREATE', 'request-id': 'req-0666c849-e99f-40a6-947f-2203ea802bf5', 'type': 'alarm', 'uuid': '693c7957-b570-471c-b915-2b7a385b2932'} 01/09/2025 02:17:13.491 7fc0e8fdd4e0 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/09/2025 02:17:13.492 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:13.534 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:13.565 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.running_package_version', 'operand2': {'uve_attribute': 'NodeStatus.installed_package_version'}, 'operation': '!='}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-package-version-mismatch', 'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'id_perms': {'created': '2025-01-09T02:17:13.554135', 'creator': None, 'description': 'There is a mismatch between ' 'installed and running package ' 'version.', 'enable': True, 'last_modified': '2025-01-09T02:17:13.554135', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9933151292459632140, 'uuid_mslong': 15577677332137330408}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd82f06ff-dfb3-46e8-89d9-a478ef44c60c', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-080ce1e7-af21-4945-bad2-951642009dd8', 'type': 'alarm', 'uuid': 'd82f06ff-dfb3-46e8-89d9-a478ef44c60c'} 01/09/2025 02:17:13.565 7fc0e8fdd4e0 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/09/2025 02:17:13.565 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:13.588 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:13.656 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.res_limit', 'operand2': {'json_value': 'true'}, 'operation': '==', 'variables': ['VrouterAgent.vr_limit_exceeded_list']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-vrouter-limit-exceeded', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'id_perms': {'created': '2025-01-09T02:17:13.639288', 'creator': None, 'description': 'Agent resource usage exceeded ' 'configured watermark for resource.', 'enable': True, 'last_modified': '2025-01-09T02:17:13.639288', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11353580258893046320, 'uuid_mslong': 10354905309498197287}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8fb40384-2f72-4527-9d90-051774352230', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-27a57ec3-f253-460c-82fc-b370b33782ef', 'type': 'alarm', 'uuid': '8fb40384-2f72-4527-9d90-051774352230'} 01/09/2025 02:17:13.656 7fc0e8fdd4e0 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/09/2025 02:17:13.657 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:13.673 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:13.729 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.res_table_limit', 'operand2': {'json_value': 'true'}, 'operation': '==', 'variables': ['VrouterAgent.vr_limit_exceeded_list']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-vrouter-table-limit-exceeded', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'id_perms': {'created': '2025-01-09T02:17:13.720673', 'creator': None, 'description': 'Agent resource usage exceeded table ' 'size for resource in vrouter.', 'enable': True, 'last_modified': '2025-01-09T02:17:13.720673', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11598472773119035830, 'uuid_mslong': 4542401281182746556}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3f09d9e6-082d-47bc-a0f6-0d892accc9b6', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-32bbeac1-d4b1-4d65-b48c-2198a024e647', 'type': 'alarm', 'uuid': '3f09d9e6-082d-47bc-a0f6-0d892accc9b6'} 01/09/2025 02:17:13.730 7fc0e8fdd4e0 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/09/2025 02:17:13.730 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:13.748 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:13.817 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.l3mh_phy_interface_down', 'operand2': {'json_value': 'true'}, 'operation': '==', 'variables': ['VrouterAgent.vr_l3mh_intf_list']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-vrouter-l3mh-physical-interface-link-down', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'id_perms': {'created': '2025-01-09T02:17:13.805488', 'creator': None, 'description': 'On l3 multihomed compute one or ' 'more physical interfaces are ' 'Inactive.', 'enable': True, 'last_modified': '2025-01-09T02:17:13.805488', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10328796806102084008, 'uuid_mslong': 15304874303921015249}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd465d617-3937-49d1-8f57-41f888e769a8', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-36539a1d-b976-4bfd-bae9-1855dd24d5f0', 'type': 'alarm', 'uuid': 'd465d617-3937-49d1-8f57-41f888e769a8'} 01/09/2025 02:17:13.817 7fc0e8fdd4e0 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/09/2025 02:17:13.817 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:13.840 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:14.708 7fc0e9c02588 [contrail-topology] [DEBUG]: Extracted sandesh length: 0000001290 01/09/2025 02:17:14.708 7fc0e9c02588 [contrail-topology] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/09/2025 02:17:14.711 7fc0eb30ceb8 [contrail-topology] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 01/09/2025 02:17:14.711 7fc0eb30ceb8 [contrail-topology] [DEBUG]: Number of uve types in sandesh control message is 2 01/09/2025 02:17:14.711 7fc0eb30ceb8 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:17:14.712 7fc0eb30ceb8 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/09/2025 02:17:14.717 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-12792160-d7cb-441e-b043-cd3bf0e3d580', 'type': 'global_vrouter_config', 'uuid': '4a40060c-f8a7-4fc8-871a-34ecadf59cde'} 01/09/2025 02:17:14.717 7fc0e8fdd4e0 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/09/2025 02:17:14.718 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:14.741 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:15.621 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-34c9e9ec-2e28-4600-941c-72e8a5651862', 'type': 'global_vrouter_config', 'uuid': '4a40060c-f8a7-4fc8-871a-34ecadf59cde'} 01/09/2025 02:17:15.621 7fc0e8fdd4e0 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/09/2025 02:17:15.621 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:15.642 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:16.547 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-5e853201-87a0-42c3-8a03-c147016cc4c4', 'type': 'global_system_config', 'uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2'} 01/09/2025 02:17:16.547 7fc0e8fdd4e0 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/09/2025 02:17:16.547 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:16.570 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:19.456 7fc0e9fe8828 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:17:38.919 7fc0ecc500f0 [contrail-topology] [INFO]: members: ['cn-jenkins-deploy-platform-juju-os-463-1-1'] 01/09/2025 02:17:38.919 7fc0ecc500f0 [contrail-topology] [INFO]: partitions: ['0', '1', '2', '3', '4', '5', '6', '7', '8', '9', '10', '11', '12', '13', '14', '15', '16', '17', '18', '19', '20', '21', '22', '23', '24', '25', '26', '27', '28', '29', '30', '31', '32', '33', '34', '35', '36', '37', '38', '39', '40', '41', '42', '43', '44', '45', '46'] 01/09/2025 02:17:39.627 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-e1b2d9f9-b30d-4be7-aa09-a428c30bbeaa', 'type': 'global_system_config', 'uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2'} 01/09/2025 02:17:39.627 7fc0e8fdd4e0 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/09/2025 02:17:39.627 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:39.654 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:39.752 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-463-1'], 'obj_dict': {'display_name': 'cn-jenkins-deploy-platform-juju-os-463-1', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-463-1'], 'id_perms': {'created': '2025-01-09T02:17:39.745131', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-09T02:17:39.745131', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10561244828635684022, 'uuid_mslong': 532377784496046314}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '076362c6-3b32-40ea-9291-14373cc2dcb6', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.0.0.30'}, 'oper': 'CREATE', 'request-id': 'req-c89ab482-fb77-468a-911d-1bf93def51b0', 'type': 'virtual_router', 'uuid': '076362c6-3b32-40ea-9291-14373cc2dcb6'} 01/09/2025 02:17:39.752 7fc0e8fdd4e0 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/09/2025 02:17:39.752 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:39.777 7fc0e8fdd4e0 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:39.932 7fc0e8fd3240 [contrail-topology] [DEBUG]: got work: ['0', '1', '2', '3', '4', '5', '6', '7', '8', '9', '10', '11', '12', '13', '14', '15', '16', '17', '18', '19', '20', '21', '22', '23', '24', '25', '26', '27', '28', '29', '30', '31', '32', '33', '34', '35', '36', '37', '38', '39', '40', '41', '42', '43', '44', '45', '46'] 01/09/2025 02:17:39.932 7fc0e8fd3240 [contrail-topology] [DEBUG]: @populate_work_items(): done! 01/09/2025 02:17:39.932 7fc0e8fd3240 [contrail-topology] [DEBUG]: work items: [] from the list [] 01/09/2025 02:17:39.932 7fc0e8fd3240 [contrail-topology] [DEBUG]: Add uve in the [ObjectAnalyticsSNMPInfo:TopologyUVE] map 01/09/2025 02:17:40.078 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-463-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-463-1', 'vhost0'], 'id_perms': {'created': '2025-01-09T02:17:40.064458', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-09T02:17:40.064458', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12942856144445515433, 'uuid_mslong': 16911707484456371175}}, 'parent_type': 'virtual-router', 'parent_uuid': '076362c6-3b32-40ea-9291-14373cc2dcb6', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'eab2745a-e456-43e7-b39e-4316d4a826a9', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:ea:b2:74:5a:e4']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '081dc85a-9efd-4324-9714-4ab2c115217f'}]}, 'oper': 'CREATE', 'request-id': 'req-e0fbc162-669c-4507-8f01-b660d34347bd', 'type': 'virtual_machine_interface', 'uuid': 'eab2745a-e456-43e7-b39e-4316d4a826a9'} 01/09/2025 02:17:40.112 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-463-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-e0fbc162-669c-4507-8f01-b660d34347bd', 'type': 'virtual_machine_interface', 'uuid': 'eab2745a-e456-43e7-b39e-4316d4a826a9'} 01/09/2025 02:17:40.124 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-a1c1fecf-a50c-47bc-b843-748c8ec2c300', 'type': 'access_control_list', 'uuid': '865eb39f-d110-4b9a-9950-5edb65423384'} 01/09/2025 02:17:48.859 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-juju-os-463-1'], 'oper': 'UPDATE', 'request-id': 'req-8b92ed53-67d6-45c0-a444-f449a560a8f7', 'type': 'bgp_router', 'uuid': '52085add-001a-44c7-8476-58cfd53a283e'} 01/09/2025 02:17:54.651 7fc0e9f40c18 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:18:11.011 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-463-1'], 'oper': 'UPDATE', 'request-id': 'req-4742e85a-0b3b-458d-a72e-f89165168207', 'type': 'virtual_router', 'uuid': '076362c6-3b32-40ea-9291-14373cc2dcb6'} 01/09/2025 02:18:11.288 7fc0e8fdd4e0 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-463-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-e00b6778-4ef8-48e6-bc67-543b5551b121', 'type': 'virtual_machine_interface', 'uuid': 'eab2745a-e456-43e7-b39e-4316d4a826a9'} 01/09/2025 02:18:16.103 7fc0e8e7ef60 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:18:26.555 7fc0e8e7ef60 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:18:32.228 7fc0e8e7ef60 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:18:52.341 7fc0e8e7ef60 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:19:00.594 7fc0e8e7ef60 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:19:06.379 7fc0e8e7ef60 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:19:11.499 7fc0e9f404e0 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:19:15.274 7fc0e9f404e0 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:21:50.861 7fc0eb87e978 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:21:55.563 7fc0eb87e978 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:22:01.156 7fc0eb87e978 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:22:05.999 7fc0eb87e978 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:25:58.379 7fc0e8e7ef60 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:26:03.079 7fc0e8e7ef60 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:26:08.803 7fc0e8e7ef60 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:27:39.942 7fc0e8fd3240 [contrail-topology] [DEBUG]: got work: ['0', '1', '2', '3', '4', '5', '6', '7', '8', '9', '10', '11', '12', '13', '14', '15', '16', '17', '18', '19', '20', '21', '22', '23', '24', '25', '26', '27', '28', '29', '30', '31', '32', '33', '34', '35', '36', '37', '38', '39', '40', '41', '42', '43', '44', '45', '46'] 01/09/2025 02:27:39.943 7fc0e8fd3240 [contrail-topology] [DEBUG]: @populate_work_items(): done! 01/09/2025 02:27:39.943 7fc0e8fd3240 [contrail-topology] [DEBUG]: work items: [] from the list [] 01/09/2025 02:27:50.318 7fc0ecf62588 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:30:17.905 7fc0ea69c978 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:30:22.716 7fc0ea69c978 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:30:28.882 7fc0ea69c978 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:31:52.621 7fc0e459d780 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:35:56.391 7fc0e8fd34e0 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:36:05.875 7fc0e8fd34e0 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:36:11.163 7fc0ea051ac8 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:36:17.369 7fc0ea051ac8 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:37:39.955 7fc0e8fd3240 [contrail-topology] [DEBUG]: got work: ['0', '1', '2', '3', '4', '5', '6', '7', '8', '9', '10', '11', '12', '13', '14', '15', '16', '17', '18', '19', '20', '21', '22', '23', '24', '25', '26', '27', '28', '29', '30', '31', '32', '33', '34', '35', '36', '37', '38', '39', '40', '41', '42', '43', '44', '45', '46'] 01/09/2025 02:37:39.955 7fc0e8fd3240 [contrail-topology] [DEBUG]: @populate_work_items(): done! 01/09/2025 02:37:39.955 7fc0e8fd3240 [contrail-topology] [DEBUG]: work items: [] from the list [] 01/09/2025 02:41:43.695 7fc0ea69c978 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:41:48.695 7fc0ea69c978 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:41:53.443 7fc0ea69c978 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:41:59.067 7fc0ea69c978 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:46:55.283 7fc0e9fe8198 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:47:39.967 7fc0e8fd3240 [contrail-topology] [DEBUG]: got work: ['0', '1', '2', '3', '4', '5', '6', '7', '8', '9', '10', '11', '12', '13', '14', '15', '16', '17', '18', '19', '20', '21', '22', '23', '24', '25', '26', '27', '28', '29', '30', '31', '32', '33', '34', '35', '36', '37', '38', '39', '40', '41', '42', '43', '44', '45', '46'] 01/09/2025 02:47:39.967 7fc0e8fd3240 [contrail-topology] [DEBUG]: @populate_work_items(): done! 01/09/2025 02:47:39.967 7fc0e8fd3240 [contrail-topology] [DEBUG]: work items: [] from the list [] 01/09/2025 02:47:45.874 7fc0eb3914e0 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:47:52.659 7fc0eb3914e0 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:47:58.683 7fc0eb3914e0 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:51:36.609 7fc0eb3914e0 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:52:59.914 7fc0eb3914e0 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:53:04.887 7fc0eb3914e0 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:53:10.623 7fc0eb3914e0 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:55:45.769 7fc0eb3914e0 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:57:39.979 7fc0e8fd3240 [contrail-topology] [DEBUG]: got work: ['0', '1', '2', '3', '4', '5', '6', '7', '8', '9', '10', '11', '12', '13', '14', '15', '16', '17', '18', '19', '20', '21', '22', '23', '24', '25', '26', '27', '28', '29', '30', '31', '32', '33', '34', '35', '36', '37', '38', '39', '40', '41', '42', '43', '44', '45', '46'] 01/09/2025 02:57:39.979 7fc0e8fd3240 [contrail-topology] [DEBUG]: @populate_work_items(): done! 01/09/2025 02:57:39.980 7fc0e8fd3240 [contrail-topology] [DEBUG]: work items: [] from the list [] 01/09/2025 02:58:10.614 7fc0eb3914e0 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:58:15.705 7fc0eb3914e0 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 02:58:21.444 7fc0eb3914e0 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/09/2025 03:00:35.889 7fc0ecf62780 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map