01/13/2025 02:10:45.830 7f6e6b03d208 [contrail-topology] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 01/13/2025 02:10:45.830 7f6e6b03d208 [contrail-topology] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 01/13/2025 02:10:45.830 7f6e6b03d208 [contrail-topology] [INFO]: SANDESH: Flow Logging: [None] -> [False] 01/13/2025 02:10:45.831 7f6e6b03d208 [contrail-topology] [DEBUG]: Add uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:10:45.832 7f6e6b03d208 [contrail-topology] [INFO]: Consistent scheduler zk start 01/13/2025 02:10:45.832 7f6e681fb198 [contrail-topology] [ERROR]: Cannot write http_port 5921 to /tmp/contrail-topology.0.http_port 01/13/2025 02:10:45.833 7f6e681fb198 [contrail-topology] [ERROR]: Starting Introspect on HTTP Port 5921 01/13/2025 02:10:45.833 7f6e681fcac8 [contrail-topology] [INFO]: Processing event[EvStart] in state[none] 01/13/2025 02:10:45.834 7f6e681fcac8 [contrail-topology] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/13/2025 02:10:45.834 7f6e681fcac8 [contrail-topology] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 01/13/2025 02:10:45.835 7f6e681fcac8 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:45.835 7f6e681fcac8 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-464-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.44:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, ] description = Zookeeper:Zookeeper[Connection to Zookeeper initialized] connection down >>, ] >> 01/13/2025 02:10:45.835 7f6e681fcac8 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:45.835 7f6e681fcac8 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:45.835 7f6e681fcac8 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-464-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.44:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Zookeeper:Zookeeper[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/13/2025 02:10:45.835 7f6e681fcac8 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:45.835 7f6e681fcac8 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:45.835 7f6e681fcac8 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-464-1:AnalyticsSNMP:contrail-topology:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 5921 start_time = 1736734245834379 collector_name = collector_ip = collector_list = [ 10.0.0.44:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 2 >> 01/13/2025 02:10:45.835 7f6e681fcac8 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:45.841 7f6e64f30390 [contrail-topology] [INFO]: Consistent scheduler listen CONNECTED 01/13/2025 02:10:45.842 7f6e64f30ac8 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:45.842 7f6e64f30ac8 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-464-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.44:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/13/2025 02:10:45.842 7f6e64f30ac8 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:46.109 7f6e64f24978 [contrail-topology] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.44:5673//'] 01/13/2025 02:10:46.125 7f6e64f24978 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/13/2025 02:10:46.139 7f6e676a5588 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:46.140 7f6e676a5588 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-464-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.44:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.44:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/13/2025 02:10:46.140 7f6e676a5588 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:46.140 7f6e676a5588 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:46.140 7f6e676a5588 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-464-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.44:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.44:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/13/2025 02:10:46.140 7f6e676a5588 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:46.171 7f6e64f24c18 [contrail-topology] [DEBUG]: Waiting for allocation... 01/13/2025 02:10:46.189 7f6e64f24978 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/13/2025 02:10:46.190 7f6e64f1e0f0 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:46.190 7f6e64f1e0f0 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-464-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.44:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.44:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/13/2025 02:10:46.190 7f6e64f1e0f0 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:46.239 7f6e64f24978 [contrail-topology] [WARNING]: RabbitMQ publish connection down 01/13/2025 02:10:46.240 7f6e676a50f0 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:46.241 7f6e676a50f0 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-464-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.44:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.44:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/13/2025 02:10:46.241 7f6e676a50f0 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:46.277 7f6e64f24978 [contrail-topology] [WARNING]: RabbitMQ publish connection ESTABLISHED 01/13/2025 02:10:46.280 7f6e676a50f0 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:46.281 7f6e676a50f0 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-464-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.44:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.44:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/13/2025 02:10:46.281 7f6e676a50f0 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:46.281 7f6e64f24978 [contrail-topology] [WARNING]: VNCCassandra started with driver cql 01/13/2025 02:10:46.284 7f6e64f24978 [contrail-topology] [WARNING]: initializing cassandra cluster 01/13/2025 02:10:46.288 7f6e64f24978 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster before create 01/13/2025 02:10:46.289 7f6e6b060b70 [contrail-topology] [WARNING]: RabbitMQ publish connection down 01/13/2025 02:10:46.291 7f6e64f1eac8 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:46.293 7f6e64f1eac8 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-464-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.44:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.44:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.44:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 01/13/2025 02:10:46.294 7f6e64f1eac8 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:46.294 7f6e64f1eac8 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:46.295 7f6e64f1eac8 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-464-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.44:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.44:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.44:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[], Database:Cassandra[] connection down >>, ] >> 01/13/2025 02:10:46.295 7f6e64f1eac8 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:46.302 7f6e64f24978 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster created 01/13/2025 02:10:46.339 7f6e6b060b70 [contrail-topology] [WARNING]: RabbitMQ publish connection ESTABLISHED 01/13/2025 02:10:46.345 7f6e66e1de10 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:46.348 7f6e66e1de10 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-464-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.44:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.44:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.44:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 01/13/2025 02:10:46.348 7f6e66e1de10 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:46.454 7f6e64f24978 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 01/13/2025 02:10:46.461 7f6e66dad828 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:46.462 7f6e66dad828 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-464-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.44:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.44:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.44:9041, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 01/13/2025 02:10:46.462 7f6e66dad828 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:46.476 7f6e64f24978 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 01/13/2025 02:10:46.477 7f6e66e41588 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:46.477 7f6e66e41588 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-464-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.44:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.44:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.44:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 01/13/2025 02:10:46.477 7f6e66e41588 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:46.505 7f6e64f24978 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 01/13/2025 02:10:46.607 7f6e64f24978 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 01/13/2025 02:10:46.608 7f6e66e5d240 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:46.610 7f6e66e5d240 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-464-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.44:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.44:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.44:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/13/2025 02:10:46.610 7f6e66e5d240 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:48.412 7f6e676a5198 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-464-1'], 'obj_dict': {'database_node_ip_address': '10.0.0.44', 'display_name': 'cn-jenkins-deploy-platform-juju-os-464-1', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-464-1'], 'id_perms': {'created': '2025-01-13T02:10:48.400500', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-13T02:10:48.400500', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9579838250813551579, 'uuid_mslong': 17757084036205726093}}, 'parent_type': 'global-system-config', 'parent_uuid': '4d38ec98-d981-4bd4-a179-3522e2e8ad58', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f66dd5d9-90cd-498d-84f2-6c220970f3db'}, 'oper': 'CREATE', 'request-id': 'req-bc6a8230-863f-442f-9d21-55509bbd93b0', 'type': 'database_node', 'uuid': 'f66dd5d9-90cd-498d-84f2-6c220970f3db'} 01/13/2025 02:10:48.413 7f6e676a5198 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/13/2025 02:10:48.413 7f6e676a5198 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/13/2025 02:10:48.413 7f6e66e41e10 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:48.414 7f6e66e41e10 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-464-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.44:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.44:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.44:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/13/2025 02:10:48.414 7f6e66e41e10 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:48.448 7f6e676a5198 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/13/2025 02:10:48.448 7f6e66dab780 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:48.449 7f6e66dab780 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-464-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.44:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.44:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.44:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/13/2025 02:10:48.449 7f6e66dab780 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/13/2025 02:10:49.836 7f6e66dc1b70 [contrail-topology] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/13/2025 02:10:49.846 7f6e66dc1b70 [contrail-topology] [INFO]: Session Event: TCP Connected 01/13/2025 02:10:49.847 7f6e66dc1b70 [contrail-topology] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/13/2025 02:10:49.847 7f6e66dc1b70 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/13/2025 02:10:49.848 7f6e66dc1b70 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-464-1 process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.44:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.44:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.44:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.44:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/13/2025 02:10:49.848 7f6e66dc1b70 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/13/2025 02:10:49.848 7f6e66dc1b70 [contrail-topology] [INFO]: Processing event[EvTcpConnected] in state[Connect] 01/13/2025 02:10:49.848 7f6e66dc1b70 [contrail-topology] [DEBUG]: Send sandesh control message. uve type count # 5 01/13/2025 02:10:49.849 7f6e66dc1b70 [contrail-topology] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 01/13/2025 02:10:49.849 7f6e66dc1b70 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/13/2025 02:10:49.849 7f6e66dc1b70 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/13/2025 02:10:49.849 7f6e66e5d4e0 [contrail-topology] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/13/2025 02:10:49.851 7f6e66e5d4e0 [contrail-topology] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/13/2025 02:10:49.856 7f6e66e5d198 [contrail-topology] [DEBUG]: Extracted sandesh length: 0000001012 01/13/2025 02:10:49.857 7f6e66e5d198 [contrail-topology] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/13/2025 02:10:49.857 7f6e64f30a20 [contrail-topology] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 01/13/2025 02:10:49.858 7f6e64f30a20 [contrail-topology] [DEBUG]: Number of uve types in sandesh control message is 0 01/13/2025 02:10:49.858 7f6e64f30a20 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:10:49.858 7f6e64f30a20 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/13/2025 02:10:49.858 7f6e64f30a20 [contrail-topology] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 01/13/2025 02:10:49.859 7f6e66dc1b70 [contrail-topology] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/13/2025 02:10:49.862 7f6e66dc1b70 [contrail-topology] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/13/2025 02:10:53.474 7f6e66dc1b70 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:11:07.598 7f6e66dc1b70 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:11:16.163 7f6e69c170f0 [contrail-topology] [INFO]: members: ['cn-jenkins-deploy-platform-juju-os-464-1-1'] 01/13/2025 02:11:16.164 7f6e69c170f0 [contrail-topology] [INFO]: partitions: ['0', '1', '2', '3', '4', '5', '6', '7', '8', '9', '10', '11', '12', '13', '14', '15', '16', '17', '18', '19', '20', '21', '22', '23', '24', '25', '26', '27', '28', '29', '30', '31', '32', '33', '34', '35', '36', '37', '38', '39', '40', '41', '42', '43', '44', '45', '46'] 01/13/2025 02:11:17.187 7f6e64f24c18 [contrail-topology] [DEBUG]: got work: ['0', '1', '2', '3', '4', '5', '6', '7', '8', '9', '10', '11', '12', '13', '14', '15', '16', '17', '18', '19', '20', '21', '22', '23', '24', '25', '26', '27', '28', '29', '30', '31', '32', '33', '34', '35', '36', '37', '38', '39', '40', '41', '42', '43', '44', '45', '46'] 01/13/2025 02:11:17.187 7f6e64f24c18 [contrail-topology] [DEBUG]: @populate_work_items(): done! 01/13/2025 02:11:17.188 7f6e64f24c18 [contrail-topology] [DEBUG]: work items: [] from the list [] 01/13/2025 02:11:17.188 7f6e64f24c18 [contrail-topology] [DEBUG]: Add uve in the [ObjectAnalyticsSNMPInfo:TopologyUVE] map 01/13/2025 02:11:23.682 7f6e66ee4048 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:11:57.624 7f6e676a5198 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-juju-os-464-1'], 'oper': 'UPDATE', 'request-id': 'req-89a3ab0e-8797-46d4-b6a2-797293bafca5', 'type': 'bgp_router', 'uuid': 'eae0cc18-d523-432a-9569-afe8cceff1cb'} 01/13/2025 02:11:57.625 7f6e676a5198 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/13/2025 02:11:57.625 7f6e676a5198 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/13/2025 02:11:57.658 7f6e676a5198 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/13/2025 02:11:59.705 7f6e66e5d978 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:13:02.482 7f6e676a5198 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-f4cc8a2a-1b28-4d75-bed8-313783c141cf', 'type': 'global_system_config', 'uuid': '4d38ec98-d981-4bd4-a179-3522e2e8ad58'} 01/13/2025 02:13:02.483 7f6e676a5198 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/13/2025 02:13:02.483 7f6e676a5198 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/13/2025 02:13:02.529 7f6e676a5198 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/13/2025 02:13:02.621 7f6e676a5198 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-464-1'], 'obj_dict': {'display_name': 'cn-jenkins-deploy-platform-juju-os-464-1', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-464-1'], 'id_perms': {'created': '2025-01-13T02:13:02.610957', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-13T02:13:02.610957', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9841754766383288371, 'uuid_mslong': 10982110672402859909}}, 'parent_type': 'global-system-config', 'parent_uuid': '4d38ec98-d981-4bd4-a179-3522e2e8ad58', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '98684b78-8899-4785-8894-efd0f0c89033', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.0.0.44'}, 'oper': 'CREATE', 'request-id': 'req-13cf4a95-ae4b-4d86-8ddf-7ef5ce09ff60', 'type': 'virtual_router', 'uuid': '98684b78-8899-4785-8894-efd0f0c89033'} 01/13/2025 02:13:02.622 7f6e676a5198 [contrail-topology] [ERROR]: Error in rabbitmq drainer greenlet: 'AnalyticsLogger' object has no attribute 'warn' 01/13/2025 02:13:02.622 7f6e676a5198 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 01/13/2025 02:13:02.683 7f6e676a5198 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/13/2025 02:13:03.004 7f6e676a5198 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-464-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-464-1', 'vhost0'], 'id_perms': {'created': '2025-01-13T02:13:02.985591', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-13T02:13:02.985591', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11680499827909768975, 'uuid_mslong': 2089746229741177457}}, 'parent_type': 'virtual-router', 'parent_uuid': '98684b78-8899-4785-8894-efd0f0c89033', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1d00451f-be6f-4a71-a219-78b52192b70f', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:1d:00:45:1f:be']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '48d5644c-5a33-4847-bdcc-981767a93de8'}]}, 'oper': 'CREATE', 'request-id': 'req-f3279191-1627-4e3b-bac4-de667ec79da6', 'type': 'virtual_machine_interface', 'uuid': '1d00451f-be6f-4a71-a219-78b52192b70f'} 01/13/2025 02:13:03.066 7f6e676a5198 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-464-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-f3279191-1627-4e3b-bac4-de667ec79da6', 'type': 'virtual_machine_interface', 'uuid': '1d00451f-be6f-4a71-a219-78b52192b70f'} 01/13/2025 02:13:03.565 7f6e676a5198 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-3ef99209-947b-4c0b-90dc-3576b6860f34', 'type': 'access_control_list', 'uuid': '75b2b521-b928-43ce-af87-47ed1ebec2b1'} 01/13/2025 02:13:06.673 7f6e66d73588 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:13:55.600 7f6e676a5198 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-464-1'], 'oper': 'UPDATE', 'request-id': 'req-55f80b0e-b8b1-4ed4-b395-19c06a306bc3', 'type': 'virtual_router', 'uuid': '98684b78-8899-4785-8894-efd0f0c89033'} 01/13/2025 02:13:55.908 7f6e676a5198 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-464-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-9036be6f-9ffe-4737-b6b0-8e8614a684b3', 'type': 'virtual_machine_interface', 'uuid': '1d00451f-be6f-4a71-a219-78b52192b70f'} 01/13/2025 02:14:00.512 7f6e616dd240 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:14:09.154 7f6e616dd240 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:14:13.939 7f6e616dd240 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:17:43.634 7f6e681fb4e0 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:17:54.569 7f6e66e41390 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:18:19.347 7f6e66e41390 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:18:24.047 7f6e66e41390 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:21:17.198 7f6e64f24c18 [contrail-topology] [DEBUG]: got work: ['0', '1', '2', '3', '4', '5', '6', '7', '8', '9', '10', '11', '12', '13', '14', '15', '16', '17', '18', '19', '20', '21', '22', '23', '24', '25', '26', '27', '28', '29', '30', '31', '32', '33', '34', '35', '36', '37', '38', '39', '40', '41', '42', '43', '44', '45', '46'] 01/13/2025 02:21:17.198 7f6e64f24c18 [contrail-topology] [DEBUG]: @populate_work_items(): done! 01/13/2025 02:21:17.199 7f6e64f24c18 [contrail-topology] [DEBUG]: work items: [] from the list [] 01/13/2025 02:22:23.192 7f6e676a5d68 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:22:27.632 7f6e676a5d68 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:22:52.740 7f6e66d75eb8 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:22:59.451 7f6e66d75eb8 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:27:01.174 7f6e66e412e8 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:27:10.054 7f6e66e412e8 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:27:15.553 7f6e66e412e8 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:28:49.653 7f6e66e6d588 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:31:17.212 7f6e64f24c18 [contrail-topology] [DEBUG]: got work: ['0', '1', '2', '3', '4', '5', '6', '7', '8', '9', '10', '11', '12', '13', '14', '15', '16', '17', '18', '19', '20', '21', '22', '23', '24', '25', '26', '27', '28', '29', '30', '31', '32', '33', '34', '35', '36', '37', '38', '39', '40', '41', '42', '43', '44', '45', '46'] 01/13/2025 02:31:17.212 7f6e64f24c18 [contrail-topology] [DEBUG]: @populate_work_items(): done! 01/13/2025 02:31:17.213 7f6e64f24c18 [contrail-topology] [DEBUG]: work items: [] from the list [] 01/13/2025 02:31:23.400 7f6e666cce10 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:31:30.994 7f6e666cce10 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:31:35.450 7f6e666cce10 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:34:39.719 7f6e666cce10 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:36:28.886 7f6e64f30eb8 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:36:33.923 7f6e64f30eb8 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:37:12.541 7f6e66d66438 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:39:59.937 7f6e66eed630 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:41:17.225 7f6e64f24c18 [contrail-topology] [DEBUG]: got work: ['0', '1', '2', '3', '4', '5', '6', '7', '8', '9', '10', '11', '12', '13', '14', '15', '16', '17', '18', '19', '20', '21', '22', '23', '24', '25', '26', '27', '28', '29', '30', '31', '32', '33', '34', '35', '36', '37', '38', '39', '40', '41', '42', '43', '44', '45', '46'] 01/13/2025 02:41:17.225 7f6e64f24c18 [contrail-topology] [DEBUG]: @populate_work_items(): done! 01/13/2025 02:41:17.225 7f6e64f24c18 [contrail-topology] [DEBUG]: work items: [] from the list [] 01/13/2025 02:41:34.273 7f6e676a5d68 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:41:39.253 7f6e66ee4b70 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:41:50.398 7f6e66ee4b70 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:45:12.653 7f6e69bed780 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:46:42.183 7f6e64f30eb8 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:47:09.896 7f6e64f30eb8 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:47:14.770 7f6e64f30eb8 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:50:59.221 7f6e64f1e4e0 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:51:17.237 7f6e64f24c18 [contrail-topology] [DEBUG]: got work: ['0', '1', '2', '3', '4', '5', '6', '7', '8', '9', '10', '11', '12', '13', '14', '15', '16', '17', '18', '19', '20', '21', '22', '23', '24', '25', '26', '27', '28', '29', '30', '31', '32', '33', '34', '35', '36', '37', '38', '39', '40', '41', '42', '43', '44', '45', '46'] 01/13/2025 02:51:17.238 7f6e64f24c18 [contrail-topology] [DEBUG]: @populate_work_items(): done! 01/13/2025 02:51:17.238 7f6e64f24c18 [contrail-topology] [DEBUG]: work items: [] from the list [] 01/13/2025 02:51:44.853 7f6e64f1e4e0 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 01/13/2025 02:51:46.611 7f6e64f2f780 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map