06/19/2025 00:52:18.834 7f4a6d017c88 [contrail-device-manager] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 06/19/2025 00:52:18.835 7f4a6d017c88 [contrail-device-manager] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 06/19/2025 00:52:18.835 7f4a6d017c88 [contrail-device-manager] [INFO]: SANDESH: Flow Logging: [None] -> [False] 06/19/2025 00:52:18.835 7f4a646f62e8 [contrail-device-manager] [INFO]: Processing event[EvStart] in state[none] 06/19/2025 00:52:18.835 7f4a646f62e8 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 06/19/2025 00:52:18.836 7f4a646f62e8 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 06/19/2025 00:52:18.836 7f4a646f62e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 06/19/2025 00:52:18.836 7f4a646f62e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:18.836 7f4a646f62e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 06/19/2025 00:52:18.836 7f4a646f62e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:18.836 7f4a646f62e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:18.836 7f4a646f62e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 start_time = 1750294338836022 collector_name = collector_ip = collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 06/19/2025 00:52:18.836 7f4a646f62e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:18.881 7f4a6d017c88 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.49:5673//', 'pyamqp://guest:guest@10.0.0.19:5673//', 'pyamqp://guest:guest@10.0.0.41:5673//'] 06/19/2025 00:52:18.903 7f4a6d017c88 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 06/19/2025 00:52:18.903 7f4a6464e588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:18.910 7f4a6464e588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 06/19/2025 00:52:18.910 7f4a6464e588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:18.910 7f4a6464e588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:18.910 7f4a6464e588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 06/19/2025 00:52:18.910 7f4a6464e588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:18.914 7f4a6d017c88 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 06/19/2025 00:52:18.915 7f4a6464e240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:18.915 7f4a6464e240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 06/19/2025 00:52:18.915 7f4a6464e240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:18.925 7f4a6d017c88 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 06/19/2025 00:52:18.926 7f4a6464e0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:18.926 7f4a6464e0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 06/19/2025 00:52:18.926 7f4a6464e0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:18.929 7f4a6d017c88 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 06/19/2025 00:52:18.930 7f4a72efa978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:18.930 7f4a72efa978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 06/19/2025 00:52:18.930 7f4a72efa978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:18.937 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Removed remaining AMQP queue from previous run 06/19/2025 00:52:18.937 7f4a6d017c88 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 06/19/2025 00:52:18.937 7f4a6d017c88 [contrail-device-manager] [WARNING]: initializing cassandra cluster 06/19/2025 00:52:18.937 7f4a6d017c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 06/19/2025 00:52:18.938 7f4a69f806d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting consumer greenlet 06/19/2025 00:52:18.938 7f4a69f806d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 06/19/2025 00:52:18.938 7f4a66e90978 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting publisher greenlet 06/19/2025 00:52:18.938 7f4a66e90978 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Publisher connection 06/19/2025 00:52:18.938 7f4a644df588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:18.939 7f4a644df588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 06/19/2025 00:52:18.939 7f4a644df588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:18.940 7f4a6d017c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 06/19/2025 00:52:18.943 7f4a66e90978 [contrail-device-manager] [INFO]: KombuAmqpClient: Publisher connection established 06/19/2025 00:52:18.943 7f4a69f806d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 06/19/2025 00:52:18.943 7f4a69f806d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Waiting for consumer 06/19/2025 00:52:18.995 7f4a6d017c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 06/19/2025 00:52:18.997 7f4a643ff198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:18.998 7f4a643ff198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 06/19/2025 00:52:18.998 7f4a643ff198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:19.005 7f4a6d017c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 06/19/2025 00:52:19.005 7f4a674208d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:19.005 7f4a674208d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 06/19/2025 00:52:19.005 7f4a674208d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:20.011 7f4a6d017c88 [contrail-device-manager] [WARNING]: Waiting for keyspace config_db_uuid to be created 06/19/2025 00:52:20.022 7f4a6d017c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 06/19/2025 00:52:20.104 7f4a6d017c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 06/19/2025 00:52:21.357 7f4a6d017c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 06/19/2025 00:52:21.809 7f4a6d017c88 [contrail-device-manager] [WARNING]: table 'obj_uuid_table', created 06/19/2025 00:52:21.870 7f4a6d017c88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 06/19/2025 00:52:22.836 7f4a6cfbe630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:52:22.838 7f4a6cfbe630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/19/2025 00:52:22.838 7f4a6cfbe630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:52:22.838 7f4a6cfbe630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:52:22.838 7f4a6cfbe630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 06/19/2025 00:52:22.838 7f4a6cfbe630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:52:22.838 7f4a6cfbe630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/19/2025 00:52:22.838 7f4a6cfbe630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/19/2025 00:52:22.838 7f4a6cfbe630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:22.839 7f4a6cfbe630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 06/19/2025 00:52:22.839 7f4a6cfbe630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:22.839 7f4a6cfbe630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:22.839 7f4a6cfbe630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 start_time = 1750294338836022 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/19/2025 00:52:22.839 7f4a6cfbe630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:23.179 7f4a6d017c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 06/19/2025 00:52:23.887 7f4a6d017c88 [contrail-device-manager] [WARNING]: table 'obj_uuid_table' fixed with properties {'gc_grace_seconds': 864000} 06/19/2025 00:52:23.894 7f4a6d017c88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 06/19/2025 00:52:24.893 7f4a6d017c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 06/19/2025 00:52:25.256 7f4a6d017c88 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table', created 06/19/2025 00:52:25.261 7f4a6d017c88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 06/19/2025 00:52:26.676 7f4a6d017c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 06/19/2025 00:52:26.838 7f4a643e0cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:52:26.841 7f4a643e0cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/19/2025 00:52:26.841 7f4a643e0cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:52:26.841 7f4a643e0cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:52:26.841 7f4a643e0cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 06/19/2025 00:52:26.841 7f4a643e0cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:52:26.841 7f4a643e0cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/19/2025 00:52:26.842 7f4a643e0cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/19/2025 00:52:26.842 7f4a643e0cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:26.842 7f4a643e0cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 06/19/2025 00:52:26.842 7f4a643e0cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:26.842 7f4a643e0cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:26.842 7f4a643e0cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 start_time = 1750294338836022 collector_name = collector_ip = 10.0.0.19:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/19/2025 00:52:26.842 7f4a643e0cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:27.798 7f4a6d017c88 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table' fixed with properties {'gc_grace_seconds': 864000} 06/19/2025 00:52:27.806 7f4a6d017c88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 06/19/2025 00:52:29.730 7f4a6d017c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 06/19/2025 00:52:29.733 7f4a6d017c88 [contrail-device-manager] [WARNING]: table 'obj_shared_table', created 06/19/2025 00:52:29.736 7f4a6d017c88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 06/19/2025 00:52:30.841 7f4a643c6780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:52:30.850 7f4a643c6780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/19/2025 00:52:30.850 7f4a643c6780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:52:30.850 7f4a643c6780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:52:30.851 7f4a643c6780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 06/19/2025 00:52:30.851 7f4a643c6780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:52:30.851 7f4a643c6780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/19/2025 00:52:30.851 7f4a643c6780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/19/2025 00:52:30.851 7f4a643c6780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:30.851 7f4a643c6780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 06/19/2025 00:52:30.851 7f4a643c6780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:30.851 7f4a643c6780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:30.851 7f4a643c6780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 start_time = 1750294338836022 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/19/2025 00:52:30.851 7f4a643c6780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:31.760 7f4a6d017c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 06/19/2025 00:52:32.684 7f4a6d017c88 [contrail-device-manager] [WARNING]: table 'obj_shared_table' fixed with properties {'gc_grace_seconds': 864000} 06/19/2025 00:52:32.690 7f4a6d017c88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 06/19/2025 00:52:32.690 7f4a643bc240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:32.690 7f4a643bc240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/19/2025 00:52:32.691 7f4a643bc240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:32.718 7f4a6d017c88 [contrail-device-manager] [ERROR]: Error in db walk read 'type' 06/19/2025 00:52:32.719 7f4a6435a630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:32.719 7f4a6435a630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Zookeeper:Zookeeper[] connection down >>, ] >> 06/19/2025 00:52:32.719 7f4a6435a630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:32.730 7f4a6436b390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:32.731 7f4a6436b390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/19/2025 00:52:32.731 7f4a6436b390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:32.731 7f4a6d017c88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_status_consumer.dummy 06/19/2025 00:52:32.731 7f4a6d017c88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_request_consumer 06/19/2025 00:52:32.731 7f4a69f806d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 06/19/2025 00:52:32.732 7f4a6d017c88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3480-2. 06/19/2025 00:52:32.735 7f4a69f806d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 06/19/2025 00:52:32.855 7f4a69f806d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3480-2.'] 06/19/2025 00:52:32.885 7f4a69f806d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 06/19/2025 00:52:32.894 7f4a69f806d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 06/19/2025 00:52:32.963 7f4a69f806d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3480-2.'] 06/19/2025 00:52:33.243 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Fetching all containers 06/19/2025 00:52:33.285 7f4a6d017c88 [contrail-device-manager] [INFO]: Restarting dnsmasq docker: config_dnsmasq_1 06/19/2025 00:52:33.456 7f4a6d017c88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3480-2..config_queue 06/19/2025 00:52:33.456 7f4a6d017c88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3480-2..tftp_queue 06/19/2025 00:52:33.957 7f4a6d017c88 [contrail-device-manager] [WARNING]: Process 138 prepared to run in Full mode... 06/19/2025 00:52:33.961 7f4a6d017c88 [contrail-device-manager] [WARNING]: Elected master Device Manager node. Initializing... 06/19/2025 00:52:33.961 7f4a6d017c88 [contrail-device-manager] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8096 06/19/2025 00:52:33.964 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add [config_updater.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/config_updater] to home page 06/19/2025 00:52:33.964 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_ConfigApiUpdateReq] 06/19/2025 00:52:33.965 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add [greenlets.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/greenlets] to home page 06/19/2025 00:52:33.966 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_GreenletObjectReq] 06/19/2025 00:52:33.967 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add [cpuinfo.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/nodeinfo/cpuinfo] to home page 06/19/2025 00:52:33.967 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CpuLoadInfoReq] 06/19/2025 00:52:33.970 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add [dm_introspect.xml:/usr/lib/python3.6/site-packages/device_manager/sandesh/dm_introspect] to home page 06/19/2025 00:52:33.970 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_RoutingInstanceList] 06/19/2025 00:52:33.970 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualNetworkList] 06/19/2025 00:52:33.970 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualMachineInterfaceList] 06/19/2025 00:52:33.970 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalInterfaceList] 06/19/2025 00:52:33.971 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalInterfaceList] 06/19/2025 00:52:33.971 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalRouterList] 06/19/2025 00:52:33.971 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_BgpRouterList] 06/19/2025 00:52:33.971 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalRouterList] 06/19/2025 00:52:33.972 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_InstanceIpList] 06/19/2025 00:52:33.972 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FloatingIpList] 06/19/2025 00:52:33.972 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PortTupleList] 06/19/2025 00:52:33.972 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FeatureFlagList] 06/19/2025 00:52:33.973 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add [sandesh_alarm.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_alarm] to home page 06/19/2025 00:52:33.973 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmCacheRequest] 06/19/2025 00:52:33.973 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmTypesRequest] 06/19/2025 00:52:33.973 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmAckRequest] 06/19/2025 00:52:33.974 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add [sandesh_ctrl.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_ctrl] to home page 06/19/2025 00:52:33.974 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlClientToServer] 06/19/2025 00:52:33.974 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlServerToClient] 06/19/2025 00:52:33.974 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add [sandesh_trace.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_trace] to home page 06/19/2025 00:52:33.976 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceRequest] 06/19/2025 00:52:33.976 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferListRequest] 06/19/2025 00:52:33.976 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceEnableDisableReq] 06/19/2025 00:52:33.976 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufStatusReq] 06/19/2025 00:52:33.976 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferEnableDisableReq] 06/19/2025 00:52:33.977 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add [sandesh_uve.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_uve] to home page 06/19/2025 00:52:33.978 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshMessageStatsReq] 06/19/2025 00:52:33.978 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsSet] 06/19/2025 00:52:33.978 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsStatus] 06/19/2025 00:52:33.978 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsSet] 06/19/2025 00:52:33.978 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsStatus] 06/19/2025 00:52:33.978 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsSet] 06/19/2025 00:52:33.978 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsReset] 06/19/2025 00:52:33.978 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsStatus] 06/19/2025 00:52:33.978 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueSet] 06/19/2025 00:52:33.978 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueStatus] 06/19/2025 00:52:33.979 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CollectorInfoRequest] 06/19/2025 00:52:33.979 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVEDSConfReq] 06/19/2025 00:52:33.980 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVECacheReq] 06/19/2025 00:52:33.980 7f4a6d017c88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVETypesReq] 06/19/2025 00:52:33.982 7f4a6d017c88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.ztp_queue 06/19/2025 00:52:33.994 7f4a64300c18 [contrail-device-manager] [ERROR]: Cannot write http_port 8096 to /tmp/contrail-device-manager.1.http_port 06/19/2025 00:52:33.995 7f4a64300c18 [contrail-device-manager] [ERROR]: Starting Introspect on HTTP Port 8096 06/19/2025 00:52:34.038 7f4a5f2c8e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:34.038 7f4a5f2c8e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Initializing description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 06/19/2025 00:52:34.038 7f4a5f2c8e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:34.049 7f4a5f1a8b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:34.049 7f4a5f1a8b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 06/19/2025 00:52:34.049 7f4a5f1a8b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:34.058 7f4a69f806d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 06/19/2025 00:52:34.063 7f4a69f806d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 06/19/2025 00:52:34.311 7f4a69f806d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3480-2.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3480-2..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3480-2..tftp_queue', 'device_manager_ztp.ztp_queue'] 06/19/2025 00:52:34.851 7f4a5f1b5d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:52:34.853 7f4a5f1b5d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/19/2025 00:52:34.853 7f4a5f1b5d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:52:34.853 7f4a5f1b5d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:52:34.853 7f4a5f1b5d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 06/19/2025 00:52:34.854 7f4a5f1b5d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:52:34.854 7f4a5f1b5d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/19/2025 00:52:34.854 7f4a5f1b5d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/19/2025 00:52:34.854 7f4a5f1b5d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:34.854 7f4a5f1b5d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 06/19/2025 00:52:34.854 7f4a5f1b5d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:34.854 7f4a5f1b5d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:34.854 7f4a5f1b5d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1750294338836022 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/19/2025 00:52:34.854 7f4a5f1b5d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:38.854 7f4a5f0e9588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:52:38.855 7f4a5f0e9588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/19/2025 00:52:38.855 7f4a5f0e9588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:52:38.855 7f4a5f0e9588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:52:38.855 7f4a5f0e9588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 06/19/2025 00:52:38.855 7f4a5f0e9588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:52:38.855 7f4a5f0e9588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/19/2025 00:52:38.856 7f4a5f0e9588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/19/2025 00:52:38.856 7f4a5f0e9588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:38.856 7f4a5f0e9588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 06/19/2025 00:52:38.856 7f4a5f0e9588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:38.856 7f4a5f0e9588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:38.856 7f4a5f0e9588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1750294338836022 collector_name = collector_ip = 10.0.0.19:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/19/2025 00:52:38.856 7f4a5f0e9588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:40.196 7f4a5f0e94e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:40.196 7f4a5f0e94e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/19/2025 00:52:40.196 7f4a5f0e94e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:42.856 7f4a5f124ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:52:42.858 7f4a5f124ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/19/2025 00:52:42.858 7f4a5f124ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:52:42.858 7f4a5f124ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:52:42.858 7f4a5f124ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/19/2025 00:52:42.858 7f4a5f124ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:52:42.858 7f4a5f124ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/19/2025 00:52:42.859 7f4a5f124ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/19/2025 00:52:42.859 7f4a5f124ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:42.859 7f4a5f124ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/19/2025 00:52:42.859 7f4a5f124ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:42.859 7f4a5f124ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:42.859 7f4a5f124ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1750294338836022 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/19/2025 00:52:42.859 7f4a5f124ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:46.859 7f4a5f081438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:52:46.860 7f4a5f081438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/19/2025 00:52:46.861 7f4a5f081438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:52:46.861 7f4a5f081438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:52:46.861 7f4a5f081438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/19/2025 00:52:46.861 7f4a5f081438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:52:46.861 7f4a5f081438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/19/2025 00:52:46.861 7f4a5f081438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/19/2025 00:52:46.861 7f4a5f081438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:46.861 7f4a5f081438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/19/2025 00:52:46.862 7f4a5f081438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:46.862 7f4a5f081438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:46.862 7f4a5f081438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1750294338836022 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/19/2025 00:52:46.862 7f4a5f081438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:50.861 7f4a6446c630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:52:50.862 7f4a6446c630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/19/2025 00:52:50.862 7f4a6446c630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:52:50.862 7f4a6446c630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:52:50.862 7f4a6446c630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/19/2025 00:52:50.862 7f4a6446c630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:52:50.862 7f4a6446c630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/19/2025 00:52:50.863 7f4a6446c630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/19/2025 00:52:50.863 7f4a6446c630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:50.863 7f4a6446c630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/19/2025 00:52:50.863 7f4a6446c630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:50.863 7f4a6446c630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:50.863 7f4a6446c630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1750294338836022 collector_name = collector_ip = 10.0.0.19:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/19/2025 00:52:50.863 7f4a6446c630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:54.863 7f4a5f217c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:52:54.864 7f4a5f217c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/19/2025 00:52:54.865 7f4a5f217c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:52:54.865 7f4a5f217c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:52:54.865 7f4a5f217c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/19/2025 00:52:54.865 7f4a5f217c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:52:54.865 7f4a5f217c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/19/2025 00:52:54.866 7f4a5f217c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/19/2025 00:52:54.866 7f4a5f217c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:54.866 7f4a5f217c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/19/2025 00:52:54.866 7f4a5f217c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:54.866 7f4a5f217c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:54.866 7f4a5f217c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1750294338836022 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/19/2025 00:52:54.866 7f4a5f217c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:58.865 7f4a5f1a8198 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:52:58.866 7f4a5f1a8198 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/19/2025 00:52:58.866 7f4a5f1a8198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:52:58.867 7f4a5f1a8198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:52:58.867 7f4a5f1a8198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/19/2025 00:52:58.867 7f4a5f1a8198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:52:58.867 7f4a5f1a8198 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/19/2025 00:52:58.867 7f4a5f1a8198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/19/2025 00:52:58.867 7f4a5f1a8198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:58.867 7f4a5f1a8198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/19/2025 00:52:58.867 7f4a5f1a8198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:58.867 7f4a5f1a8198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:52:58.867 7f4a5f1a8198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1750294338836022 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/19/2025 00:52:58.867 7f4a5f1a8198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:02.867 7f4a643c9630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:53:02.869 7f4a643c9630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/19/2025 00:53:02.869 7f4a643c9630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:53:02.869 7f4a643c9630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:53:02.869 7f4a643c9630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/19/2025 00:53:02.869 7f4a643c9630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:53:02.869 7f4a643c9630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/19/2025 00:53:02.870 7f4a643c9630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/19/2025 00:53:02.870 7f4a643c9630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:02.870 7f4a643c9630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/19/2025 00:53:02.870 7f4a643c9630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:02.870 7f4a643c9630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:02.870 7f4a643c9630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1750294338836022 collector_name = collector_ip = 10.0.0.19:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/19/2025 00:53:02.870 7f4a643c9630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:06.870 7f4a643c96d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:53:06.871 7f4a643c96d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/19/2025 00:53:06.871 7f4a643c96d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:53:06.871 7f4a643c96d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:53:06.871 7f4a643c96d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/19/2025 00:53:06.871 7f4a643c96d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:53:06.871 7f4a643c96d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/19/2025 00:53:06.872 7f4a643c96d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/19/2025 00:53:06.872 7f4a643c96d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:06.872 7f4a643c96d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/19/2025 00:53:06.872 7f4a643c96d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:06.872 7f4a643c96d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:06.872 7f4a643c96d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1750294338836022 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/19/2025 00:53:06.872 7f4a643c96d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:10.871 7f4a643b3e10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:53:10.872 7f4a643b3e10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/19/2025 00:53:10.873 7f4a643b3e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:53:10.873 7f4a643b3e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:53:10.873 7f4a643b3e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/19/2025 00:53:10.873 7f4a643b3e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:53:10.873 7f4a643b3e10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/19/2025 00:53:10.873 7f4a643b3e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/19/2025 00:53:10.873 7f4a643b3e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:10.873 7f4a643b3e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/19/2025 00:53:10.874 7f4a643b3e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:10.874 7f4a643b3e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:10.874 7f4a643b3e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1750294338836022 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/19/2025 00:53:10.874 7f4a643b3e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:14.874 7f4a643eb8d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:53:14.875 7f4a643eb8d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/19/2025 00:53:14.875 7f4a643eb8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:53:14.875 7f4a643eb8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:53:14.875 7f4a643eb8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/19/2025 00:53:14.875 7f4a643eb8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:53:14.875 7f4a643eb8d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/19/2025 00:53:14.876 7f4a643eb8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/19/2025 00:53:14.876 7f4a643eb8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:14.876 7f4a643eb8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/19/2025 00:53:14.876 7f4a643eb8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:14.876 7f4a643eb8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:14.876 7f4a643eb8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1750294338836022 collector_name = collector_ip = 10.0.0.19:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/19/2025 00:53:14.876 7f4a643eb8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:18.875 7f4a6a0f1240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:53:18.877 7f4a6a0f1240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/19/2025 00:53:18.877 7f4a6a0f1240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:53:18.877 7f4a6a0f1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:53:18.877 7f4a6a0f1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/19/2025 00:53:18.877 7f4a6a0f1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:53:18.877 7f4a6a0f1240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/19/2025 00:53:18.878 7f4a6a0f1240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/19/2025 00:53:18.878 7f4a6a0f1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:18.878 7f4a6a0f1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/19/2025 00:53:18.878 7f4a6a0f1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:18.878 7f4a6a0f1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:18.878 7f4a6a0f1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1750294338836022 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/19/2025 00:53:18.878 7f4a6a0f1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:22.877 7f4a6464e630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:53:22.878 7f4a6464e630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/19/2025 00:53:22.879 7f4a6464e630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:53:22.879 7f4a6464e630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:53:22.879 7f4a6464e630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/19/2025 00:53:22.879 7f4a6464e630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:53:22.879 7f4a6464e630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/19/2025 00:53:22.879 7f4a6464e630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/19/2025 00:53:22.879 7f4a6464e630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:22.879 7f4a6464e630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/19/2025 00:53:22.879 7f4a6464e630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:22.879 7f4a6464e630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:22.880 7f4a6464e630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1750294338836022 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/19/2025 00:53:22.880 7f4a6464e630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:26.720 7f4a6d017c88 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 06/19/2025 00:53:26.720 7f4a6d017c88 [contrail-device-manager] [WARNING]: initializing cassandra cluster 06/19/2025 00:53:26.721 7f4a6d017c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 06/19/2025 00:53:26.721 7f4a6b385d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:26.722 7f4a6b385d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 06/19/2025 00:53:26.722 7f4a6b385d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:26.724 7f4a6d017c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 06/19/2025 00:53:26.756 7f4a6d017c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 06/19/2025 00:53:26.758 7f4a5f1894e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:26.759 7f4a5f1894e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Initializing description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 06/19/2025 00:53:26.759 7f4a5f1894e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:26.766 7f4a6d017c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 06/19/2025 00:53:26.766 7f4a5f189390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:26.766 7f4a5f189390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 06/19/2025 00:53:26.766 7f4a5f189390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:26.784 7f4a6d017c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 06/19/2025 00:53:26.879 7f4a5f0876d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:53:26.882 7f4a5f0876d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/19/2025 00:53:26.882 7f4a5f0876d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:53:26.882 7f4a5f0876d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:53:26.882 7f4a5f0876d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 06/19/2025 00:53:26.882 7f4a5f0876d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:53:26.882 7f4a5f0876d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/19/2025 00:53:26.883 7f4a5f0876d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/19/2025 00:53:26.883 7f4a5f0876d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:26.883 7f4a5f0876d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 06/19/2025 00:53:26.883 7f4a5f0876d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:26.883 7f4a5f0876d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:26.883 7f4a5f0876d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1750294338836022 collector_name = collector_ip = 10.0.0.19:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/19/2025 00:53:26.883 7f4a5f0876d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:27.871 7f4a6d017c88 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace', created 06/19/2025 00:53:27.877 7f4a6d017c88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 06/19/2025 00:53:27.886 7f4a6d017c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 06/19/2025 00:53:28.755 7f4a6d017c88 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None} 06/19/2025 00:53:28.760 7f4a6d017c88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 06/19/2025 00:53:28.760 7f4a6d017c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 06/19/2025 00:53:28.837 7f4a6d017c88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 06/19/2025 00:53:28.845 7f4a6d017c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 06/19/2025 00:53:29.847 7f4a6d017c88 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table', created 06/19/2025 00:53:29.854 7f4a6d017c88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 06/19/2025 00:53:29.862 7f4a6d017c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 06/19/2025 00:53:30.883 7f4a5f038240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:53:30.884 7f4a5f038240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/19/2025 00:53:30.884 7f4a5f038240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:53:30.884 7f4a5f038240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:53:30.884 7f4a5f038240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 06/19/2025 00:53:30.884 7f4a5f038240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:53:30.885 7f4a5f038240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/19/2025 00:53:30.885 7f4a5f038240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/19/2025 00:53:30.885 7f4a5f038240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:30.885 7f4a5f038240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 06/19/2025 00:53:30.885 7f4a5f038240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:30.885 7f4a5f038240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:30.885 7f4a5f038240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1750294338836022 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/19/2025 00:53:30.885 7f4a5f038240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:31.182 7f4a6d017c88 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table' fixed with properties {'gc_grace_seconds': 864000} 06/19/2025 00:53:31.187 7f4a6d017c88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 06/19/2025 00:53:31.193 7f4a6d017c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 06/19/2025 00:53:32.184 7f4a6d017c88 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table', created 06/19/2025 00:53:32.195 7f4a6d017c88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 06/19/2025 00:53:32.201 7f4a6d017c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 06/19/2025 00:53:33.320 7f4a6d017c88 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table' fixed with properties {'gc_grace_seconds': 864000} 06/19/2025 00:53:33.325 7f4a6d017c88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 06/19/2025 00:53:33.331 7f4a6d017c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 06/19/2025 00:53:33.842 7f4a6d017c88 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table', created 06/19/2025 00:53:33.846 7f4a6d017c88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 06/19/2025 00:53:33.856 7f4a6d017c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 06/19/2025 00:53:34.860 7f4a6d017c88 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table' fixed with properties {'gc_grace_seconds': 864000} 06/19/2025 00:53:34.865 7f4a6d017c88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 06/19/2025 00:53:34.872 7f4a6d017c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 06/19/2025 00:53:34.885 7f4a5f189198 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:53:34.886 7f4a5f189198 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/19/2025 00:53:34.886 7f4a5f189198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:53:34.886 7f4a5f189198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:53:34.887 7f4a5f189198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 06/19/2025 00:53:34.887 7f4a5f189198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:53:34.887 7f4a5f189198 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/19/2025 00:53:34.887 7f4a5f189198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/19/2025 00:53:34.887 7f4a5f189198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:34.887 7f4a5f189198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 06/19/2025 00:53:34.887 7f4a5f189198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:34.887 7f4a5f189198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:34.887 7f4a5f189198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1750294338836022 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/19/2025 00:53:34.888 7f4a5f189198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:35.205 7f4a6d017c88 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table', created 06/19/2025 00:53:35.209 7f4a6d017c88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 06/19/2025 00:53:35.215 7f4a6d017c88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 06/19/2025 00:53:36.271 7f4a6d017c88 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table' fixed with properties {'gc_grace_seconds': 864000} 06/19/2025 00:53:36.276 7f4a6d017c88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 06/19/2025 00:53:36.276 7f4a5f0428d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:36.277 7f4a5f0428d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/19/2025 00:53:36.277 7f4a5f0428d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:36.331 7f4a6d017c88 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.49:5673//', 'pyamqp://guest:guest@10.0.0.19:5673//', 'pyamqp://guest:guest@10.0.0.41:5673//'] 06/19/2025 00:53:36.332 7f4a6d017c88 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 06/19/2025 00:53:36.332 7f4a5f0d28d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:36.333 7f4a5f0d28d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Initializing description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 06/19/2025 00:53:36.333 7f4a5f0d28d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:36.333 7f4a5f0d28d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:36.333 7f4a5f0d28d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 06/19/2025 00:53:36.333 7f4a5f0d28d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:36.337 7f4a6d017c88 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 06/19/2025 00:53:36.337 7f4a5f0d2e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:36.337 7f4a5f0d2e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/19/2025 00:53:36.337 7f4a5f0d2e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:36.363 7f4a6d017c88 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 06/19/2025 00:53:36.363 7f4a5f0d28d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:36.364 7f4a5f0d28d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 06/19/2025 00:53:36.364 7f4a5f0d28d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:36.370 7f4a6d017c88 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 06/19/2025 00:53:36.370 7f4a5f0d2e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:36.371 7f4a5f0d2e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/19/2025 00:53:36.371 7f4a5f0d2e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:36.372 7f4a5f25b198 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 06/19/2025 00:53:36.372 7f4a6446cc18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:36.372 7f4a6446cc18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 06/19/2025 00:53:36.372 7f4a6446cc18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:36.380 7f4a5f25b198 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 06/19/2025 00:53:36.381 7f4a5f04b780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:36.381 7f4a5f04b780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/19/2025 00:53:36.381 7f4a5f04b780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:36.565 7f4a5f042390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-4686a1d7-7d04-44f9-a439-4c061b1e2dbd', 'type': 'global_system_config', 'uuid': '16f36867-0f4f-4870-b9a4-6d776ce86583'} 06/19/2025 00:53:38.887 7f4a6530d588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:53:38.888 7f4a6530d588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/19/2025 00:53:38.889 7f4a6530d588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:53:38.889 7f4a6530d588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:53:38.889 7f4a6530d588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/19/2025 00:53:38.889 7f4a6530d588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:53:38.889 7f4a6530d588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/19/2025 00:53:38.889 7f4a6530d588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/19/2025 00:53:38.889 7f4a6530d588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:38.890 7f4a6530d588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/19/2025 00:53:38.890 7f4a6530d588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:38.890 7f4a6530d588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:38.890 7f4a6530d588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1750294338836022 collector_name = collector_ip = 10.0.0.19:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/19/2025 00:53:38.890 7f4a6530d588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:42.889 7f4a6530d588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:53:42.890 7f4a6530d588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/19/2025 00:53:42.891 7f4a6530d588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:53:42.891 7f4a6530d588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:53:42.891 7f4a6530d588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/19/2025 00:53:42.891 7f4a6530d588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:53:42.891 7f4a6530d588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/19/2025 00:53:42.891 7f4a6530d588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/19/2025 00:53:42.891 7f4a6530d588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:42.891 7f4a6530d588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/19/2025 00:53:42.891 7f4a6530d588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:42.891 7f4a6530d588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:42.892 7f4a6530d588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1750294338836022 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/19/2025 00:53:42.892 7f4a6530d588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:46.891 7f4a6530d588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:53:46.893 7f4a6530d588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/19/2025 00:53:46.893 7f4a6530d588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:53:46.893 7f4a6530d588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:53:46.893 7f4a6530d588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/19/2025 00:53:46.893 7f4a6530d588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:53:46.893 7f4a6530d588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/19/2025 00:53:46.893 7f4a6530d588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/19/2025 00:53:46.894 7f4a6530d588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:46.894 7f4a6530d588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/19/2025 00:53:46.894 7f4a6530d588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:46.894 7f4a6530d588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:46.894 7f4a6530d588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1750294338836022 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/19/2025 00:53:46.894 7f4a6530d588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:50.893 7f4a6530d588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:53:50.895 7f4a6530d588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/19/2025 00:53:50.895 7f4a6530d588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:53:50.895 7f4a6530d588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:53:50.895 7f4a6530d588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/19/2025 00:53:50.895 7f4a6530d588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:53:50.895 7f4a6530d588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/19/2025 00:53:50.895 7f4a6530d588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/19/2025 00:53:50.895 7f4a6530d588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:50.896 7f4a6530d588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/19/2025 00:53:50.896 7f4a6530d588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:50.896 7f4a6530d588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:50.896 7f4a6530d588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1750294338836022 collector_name = collector_ip = 10.0.0.19:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/19/2025 00:53:50.896 7f4a6530d588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:54.895 7f4a6530d588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:53:54.898 7f4a6530d588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/19/2025 00:53:54.898 7f4a6530d588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:53:54.898 7f4a6530d588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:53:54.898 7f4a6530d588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/19/2025 00:53:54.898 7f4a6530d588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:53:54.898 7f4a6530d588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/19/2025 00:53:54.899 7f4a6530d588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/19/2025 00:53:54.899 7f4a6530d588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:54.899 7f4a6530d588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/19/2025 00:53:54.899 7f4a6530d588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:54.899 7f4a6530d588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:54.899 7f4a6530d588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1750294338836022 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/19/2025 00:53:54.899 7f4a6530d588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:58.899 7f4a6530d588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:53:58.935 7f4a6530d588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/19/2025 00:53:58.936 7f4a6530d588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:53:58.936 7f4a6530d588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:53:58.936 7f4a6530d588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/19/2025 00:53:58.936 7f4a6530d588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:53:58.936 7f4a6530d588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/19/2025 00:53:58.937 7f4a6530d588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/19/2025 00:53:58.937 7f4a6530d588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:58.937 7f4a6530d588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/19/2025 00:53:58.937 7f4a6530d588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:58.937 7f4a6530d588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:53:58.938 7f4a6530d588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1750294338836022 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/19/2025 00:53:58.938 7f4a6530d588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:54:02.465 7f4a5f042390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3480-1.'], 'obj_dict': {'database_node_ip_address': '10.0.0.49', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3480-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3480-1.'], 'id_perms': {'created': '2025-06-19T00:54:02.444955', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-19T00:54:02.444955', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10803860199782476314, 'uuid_mslong': 12525349396816284386}}, 'parent_type': 'global-system-config', 'parent_uuid': '16f36867-0f4f-4870-b9a4-6d776ce86583', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'add2faea-0ce3-4ae2-95ef-059c4303ea1a'}, 'oper': 'CREATE', 'request-id': 'req-c5bbee95-024c-4fd4-acb8-056a3447a19b', 'type': 'database_node', 'uuid': 'add2faea-0ce3-4ae2-95ef-059c4303ea1a'} 06/19/2025 00:54:02.488 7f4a5f042390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3480-3.'], 'obj_dict': {'database_node_ip_address': '10.0.0.41', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3480-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3480-3.'], 'id_perms': {'created': '2025-06-19T00:54:02.457717', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-19T00:54:02.457717', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9911197650245811037, 'uuid_mslong': 3603055674493062431}}, 'parent_type': 'global-system-config', 'parent_uuid': '16f36867-0f4f-4870-b9a4-6d776ce86583', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3200a00b-d01d-4d1f-898b-a5c049967b5d'}, 'oper': 'CREATE', 'request-id': 'req-9cea4f2a-cbb5-4d92-a288-0ade493ff2aa', 'type': 'database_node', 'uuid': '3200a00b-d01d-4d1f-898b-a5c049967b5d'} 06/19/2025 00:54:02.499 7f4a5f042390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3480-2.'], 'obj_dict': {'database_node_ip_address': '10.0.0.19', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3480-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3480-2.'], 'id_perms': {'created': '2025-06-19T00:54:02.470574', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-19T00:54:02.470574', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11523716352188596948, 'uuid_mslong': 16486920098252342458}}, 'parent_type': 'global-system-config', 'parent_uuid': '16f36867-0f4f-4870-b9a4-6d776ce86583', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e4cd4e7a-5894-44ba-9fec-76f7908fc2d4'}, 'oper': 'CREATE', 'request-id': 'req-c5b2cc81-2027-4747-aa3a-8f7a6fdc7e3b', 'type': 'database_node', 'uuid': 'e4cd4e7a-5894-44ba-9fec-76f7908fc2d4'} 06/19/2025 00:54:02.936 7f4a5f04b8d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:54:02.938 7f4a5f04b8d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/19/2025 00:54:02.938 7f4a5f04b8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:54:02.938 7f4a5f04b8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:54:02.938 7f4a5f04b8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/19/2025 00:54:02.938 7f4a5f04b8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:54:02.938 7f4a5f04b8d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/19/2025 00:54:02.939 7f4a5f04b8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/19/2025 00:54:02.939 7f4a5f04b8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:54:02.939 7f4a5f04b8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/19/2025 00:54:02.939 7f4a5f04b8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:54:02.939 7f4a5f04b8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:54:02.939 7f4a5f04b8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1750294338836022 collector_name = collector_ip = 10.0.0.19:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/19/2025 00:54:02.939 7f4a5f04b8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:54:06.939 7f4a653116d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:54:06.940 7f4a653116d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/19/2025 00:54:06.940 7f4a653116d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:54:06.940 7f4a653116d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:54:06.941 7f4a653116d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/19/2025 00:54:06.941 7f4a653116d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:54:06.941 7f4a653116d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/19/2025 00:54:06.941 7f4a653116d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/19/2025 00:54:06.941 7f4a653116d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:54:06.941 7f4a653116d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/19/2025 00:54:06.941 7f4a653116d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:54:06.941 7f4a653116d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:54:06.941 7f4a653116d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1750294338836022 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/19/2025 00:54:06.941 7f4a653116d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:54:10.945 7f4a5f129048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:54:10.946 7f4a5f129048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/19/2025 00:54:10.946 7f4a5f129048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:54:10.946 7f4a5f129048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:54:10.946 7f4a5f129048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/19/2025 00:54:10.946 7f4a5f129048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:54:10.947 7f4a5f129048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/19/2025 00:54:10.947 7f4a5f129048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/19/2025 00:54:10.947 7f4a5f129048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:54:10.947 7f4a5f129048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/19/2025 00:54:10.947 7f4a5f129048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:54:10.947 7f4a5f129048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:54:10.947 7f4a5f129048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1750294338836022 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/19/2025 00:54:10.947 7f4a5f129048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:54:14.947 7f4a5f129048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:54:14.948 7f4a5f129048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/19/2025 00:54:14.948 7f4a5f129048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:54:14.948 7f4a5f129048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:54:14.948 7f4a5f129048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/19/2025 00:54:14.948 7f4a5f129048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:54:14.948 7f4a5f129048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/19/2025 00:54:14.948 7f4a5f129048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/19/2025 00:54:14.949 7f4a5f129048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:54:14.949 7f4a5f129048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/19/2025 00:54:14.949 7f4a5f129048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:54:14.949 7f4a5f129048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:54:14.949 7f4a5f129048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1750294338836022 collector_name = collector_ip = 10.0.0.19:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/19/2025 00:54:14.949 7f4a5f129048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:54:18.948 7f4a5f129048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:54:18.950 7f4a5f129048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/19/2025 00:54:18.950 7f4a5f129048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:54:18.950 7f4a5f129048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:54:18.950 7f4a5f129048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/19/2025 00:54:18.950 7f4a5f129048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:54:18.950 7f4a5f129048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/19/2025 00:54:18.951 7f4a5f129048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/19/2025 00:54:18.951 7f4a5f129048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:54:18.951 7f4a5f129048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/19/2025 00:54:18.951 7f4a5f129048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:54:18.951 7f4a5f129048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:54:18.951 7f4a5f129048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1750294338836022 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/19/2025 00:54:18.951 7f4a5f129048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:54:22.951 7f4a643ebac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:54:22.952 7f4a643ebac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/19/2025 00:54:22.952 7f4a643ebac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:54:22.952 7f4a643ebac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:54:22.953 7f4a643ebac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/19/2025 00:54:22.953 7f4a643ebac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:54:22.953 7f4a643ebac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/19/2025 00:54:22.953 7f4a643ebac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/19/2025 00:54:22.953 7f4a643ebac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:54:22.953 7f4a643ebac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/19/2025 00:54:22.953 7f4a643ebac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:54:22.953 7f4a643ebac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:54:22.953 7f4a643ebac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1750294338836022 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/19/2025 00:54:22.954 7f4a643ebac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:54:26.953 7f4a5f045438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:54:26.954 7f4a5f045438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/19/2025 00:54:26.954 7f4a5f045438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:54:26.954 7f4a5f045438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:54:26.955 7f4a5f045438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/19/2025 00:54:26.955 7f4a5f045438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:54:26.955 7f4a5f045438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/19/2025 00:54:26.955 7f4a5f045438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/19/2025 00:54:26.955 7f4a5f045438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:54:26.955 7f4a5f045438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/19/2025 00:54:26.955 7f4a5f045438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:54:26.955 7f4a5f045438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:54:26.955 7f4a5f045438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1750294338836022 collector_name = collector_ip = 10.0.0.19:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.19:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/19/2025 00:54:26.955 7f4a5f045438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/19/2025 00:54:30.150 7f4a5f042390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3480-1.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.49', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3480-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3480-1.'], 'id_perms': {'created': '2025-06-19T00:54:30.112979', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-19T00:54:30.112979', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13080301582278256882, 'uuid_mslong': 12839746647631282607}}, 'parent_type': 'global-system-config', 'parent_uuid': '16f36867-0f4f-4870-b9a4-6d776ce86583', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b22ff18c-5213-41af-b586-90fc96ace8f2'}, 'oper': 'CREATE', 'request-id': 'req-96eb4047-315a-4dd6-9fee-c46047734956', 'type': 'analytics_node', 'uuid': 'b22ff18c-5213-41af-b586-90fc96ace8f2'} 06/19/2025 00:54:30.165 7f4a5f042390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3480-3.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.41', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3480-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3480-3.'], 'id_perms': {'created': '2025-06-19T00:54:30.140090', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-19T00:54:30.140090', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13375207193639258492, 'uuid_mslong': 1174654645924938048}}, 'parent_type': 'global-system-config', 'parent_uuid': '16f36867-0f4f-4870-b9a4-6d776ce86583', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '104d362d-481e-4140-b99e-4813e61e097c'}, 'oper': 'CREATE', 'request-id': 'req-574615b5-58d6-491d-868c-0ae104dea019', 'type': 'analytics_node', 'uuid': '104d362d-481e-4140-b99e-4813e61e097c'} 06/19/2025 00:54:30.209 7f4a5f042390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3480-2.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.19', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3480-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3480-2.'], 'id_perms': {'created': '2025-06-19T00:54:30.184965', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-19T00:54:30.184965', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12886868077550190568, 'uuid_mslong': 8652289711519518654}}, 'parent_type': 'global-system-config', 'parent_uuid': '16f36867-0f4f-4870-b9a4-6d776ce86583', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '78131ba6-9ce3-4fbe-b2d7-5a3d2db33fe8'}, 'oper': 'CREATE', 'request-id': 'req-5a01cc37-6386-45d9-82bc-964d44b0931e', 'type': 'analytics_node', 'uuid': '78131ba6-9ce3-4fbe-b2d7-5a3d2db33fe8'} 06/19/2025 00:54:30.955 7f4a5f040780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/19/2025 00:54:30.957 7f4a5f040780 [contrail-device-manager] [INFO]: Session Event: TCP Connected 06/19/2025 00:54:30.957 7f4a5f040780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/19/2025 00:54:30.957 7f4a5f040780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:54:30.957 7f4a5f040780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3480-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.49:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.49:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.49:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.49,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/19/2025 00:54:30.957 7f4a5f040780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/19/2025 00:54:30.957 7f4a5f040780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnected] in state[Connect] 06/19/2025 00:54:30.958 7f4a5f040780 [contrail-device-manager] [DEBUG]: Send sandesh control message. uve type count # 19 06/19/2025 00:54:30.958 7f4a5f040780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 06/19/2025 00:54:30.958 7f4a5f040780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 06/19/2025 00:54:30.960 7f4a5f040780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 06/19/2025 00:54:30.961 7f4a5ef64a20 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 06/19/2025 00:54:30.962 7f4a5ef64a20 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 06/19/2025 00:54:39.380 7f4a5f042f60 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001016 06/19/2025 00:54:39.381 7f4a5f042f60 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 06/19/2025 00:54:39.381 7f4a643f0978 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 06/19/2025 00:54:39.382 7f4a643f0978 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 0 06/19/2025 00:54:39.382 7f4a643f0978 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/19/2025 00:54:39.382 7f4a643f0978 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 06/19/2025 00:54:39.382 7f4a643f0978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 06/19/2025 00:54:39.382 7f4a5f0d3e10 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 06/19/2025 00:54:39.384 7f4a5f0d3e10 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 06/19/2025 00:54:45.871 7f4a5f042390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3480-1.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.49', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3480-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3480-1.'], 'id_perms': {'created': '2025-06-19T00:54:45.835272', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-19T00:54:45.835272', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10522336737994856119, 'uuid_mslong': 9617537146460065328}}, 'parent_type': 'global-system-config', 'parent_uuid': '16f36867-0f4f-4870-b9a4-6d776ce86583', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '85785b14-2ce0-4e30-9206-d9837339d6b7'}, 'oper': 'CREATE', 'request-id': 'req-6ac5c20e-2426-4aaf-92bd-c17a54beaaa5', 'type': 'analytics_alarm_node', 'uuid': '85785b14-2ce0-4e30-9206-d9837339d6b7'} 06/19/2025 00:54:46.385 7f4a5f042390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3480-3.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.41', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3480-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3480-3.'], 'id_perms': {'created': '2025-06-19T00:54:46.363559', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-19T00:54:46.363559', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13421142237857253025, 'uuid_mslong': 113725096304921886}}, 'parent_type': 'global-system-config', 'parent_uuid': '16f36867-0f4f-4870-b9a4-6d776ce86583', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '0194085f-5f4d-4d1e-ba41-79c1cf7906a1'}, 'oper': 'CREATE', 'request-id': 'req-9bceb101-62f5-42a1-a3ef-f3e553afe17d', 'type': 'analytics_alarm_node', 'uuid': '0194085f-5f4d-4d1e-ba41-79c1cf7906a1'} 06/19/2025 00:54:46.513 7f4a5f042390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3480-2.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.19', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3480-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3480-2.'], 'id_perms': {'created': '2025-06-19T00:54:46.503971', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-19T00:54:46.503971', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13491777800686442087, 'uuid_mslong': 13909754688182963731}}, 'parent_type': 'global-system-config', 'parent_uuid': '16f36867-0f4f-4870-b9a4-6d776ce86583', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c1096031-1df8-4e13-bb3c-6c6d5e6a9667'}, 'oper': 'CREATE', 'request-id': 'req-faff6feb-fd84-4eb9-be81-4ac6fbee5aa0', 'type': 'analytics_alarm_node', 'uuid': 'c1096031-1df8-4e13-bb3c-6c6d5e6a9667'} 06/19/2025 00:54:49.312 7f4a5f042f60 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001296 06/19/2025 00:54:49.313 7f4a5f042f60 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 06/19/2025 00:54:49.313 7f4a6466d6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 06/19/2025 00:54:49.313 7f4a6466d6d8 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 2 06/19/2025 00:54:49.313 7f4a6466d6d8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/19/2025 00:54:49.313 7f4a6466d6d8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 06/19/2025 00:54:55.384 7f4a5f042390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3480-2.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.19', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3480-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3480-2.'], 'id_perms': {'created': '2025-06-19T00:54:55.357996', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-19T00:54:55.357996', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12249665124340746242, 'uuid_mslong': 13184915883370759553}}, 'parent_type': 'global-system-config', 'parent_uuid': '16f36867-0f4f-4870-b9a4-6d776ce86583', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b6fa3b23-a5b8-4581-a9ff-8d8771d24802'}, 'oper': 'CREATE', 'request-id': 'req-f562f7d6-7e2d-43b4-be3d-b96ad0d37684', 'type': 'analytics_snmp_node', 'uuid': 'b6fa3b23-a5b8-4581-a9ff-8d8771d24802'} 06/19/2025 00:54:55.395 7f4a5f042390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3480-1.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.49', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3480-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3480-1.'], 'id_perms': {'created': '2025-06-19T00:54:55.377260', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-19T00:54:55.377260', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11063561868524376279, 'uuid_mslong': 9378186324302253781}}, 'parent_type': 'global-system-config', 'parent_uuid': '16f36867-0f4f-4870-b9a4-6d776ce86583', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '822602c6-3176-4ed5-9989-aae6f3f3d0d7'}, 'oper': 'CREATE', 'request-id': 'req-bb01ca4c-0a67-4212-ad62-753930a20db6', 'type': 'analytics_snmp_node', 'uuid': '822602c6-3176-4ed5-9989-aae6f3f3d0d7'} 06/19/2025 00:54:55.467 7f4a5f042390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3480-3.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.41', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3480-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3480-3.'], 'id_perms': {'created': '2025-06-19T00:54:55.440070', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-19T00:54:55.440070', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13786847755602752109, 'uuid_mslong': 11994228080816112353}}, 'parent_type': 'global-system-config', 'parent_uuid': '16f36867-0f4f-4870-b9a4-6d776ce86583', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a6740ee4-300f-42e1-bf54-b8fce517f26d'}, 'oper': 'CREATE', 'request-id': 'req-d9a51d79-15db-4b27-bccd-12a65c9ef1fb', 'type': 'analytics_snmp_node', 'uuid': 'a6740ee4-300f-42e1-bf54-b8fce517f26d'} 06/19/2025 00:56:34.383 7f4a5f042390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-a17cd9b8-e19e-47cf-870a-d3525cd4ff0d', 'type': 'global_system_config', 'uuid': '16f36867-0f4f-4870-b9a4-6d776ce86583'} 06/19/2025 00:56:34.455 7f4a5f042390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-7622a527-07c1-4dd4-991c-b007cefbe14e', 'type': 'global_system_config', 'uuid': '16f36867-0f4f-4870-b9a4-6d776ce86583'} 06/19/2025 00:56:34.513 7f4a5f042390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3480-1'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-3480-1', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3480-1'], 'id_perms': {'created': '2025-06-19T00:56:34.505273', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-19T00:56:34.505273', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11748902901236899342, 'uuid_mslong': 8901944323461103811}}, 'parent_type': 'global-system-config', 'parent_uuid': '16f36867-0f4f-4870-b9a4-6d776ce86583', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7b8a0f32-9a34-40c3-a30c-7cf0b8c81e0e', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.25'}, 'oper': 'CREATE', 'request-id': 'req-8bfdbea3-b8c9-400b-86ff-4cc4acb0744a', 'type': 'virtual_router', 'uuid': '7b8a0f32-9a34-40c3-a30c-7cf0b8c81e0e'} 06/19/2025 00:56:34.569 7f4a5f042390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3480-2'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-3480-2', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3480-2'], 'id_perms': {'created': '2025-06-19T00:56:34.561466', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-19T00:56:34.561466', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12676776253390856465, 'uuid_mslong': 5780327209270528617}}, 'parent_type': 'global-system-config', 'parent_uuid': '16f36867-0f4f-4870-b9a4-6d776ce86583', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5037d8f8-aa18-4a69-afec-f4d688782111', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.193'}, 'oper': 'CREATE', 'request-id': 'req-15d530aa-19f1-4c60-b832-03740ed83d1e', 'type': 'virtual_router', 'uuid': '5037d8f8-aa18-4a69-afec-f4d688782111'} 06/19/2025 00:56:34.854 7f4a5f042390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3480-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3480-1', 'vhost0'], 'id_perms': {'created': '2025-06-19T00:56:34.835673', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-19T00:56:34.835673', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12860914346413253482, 'uuid_mslong': 7399315088156543403}}, 'parent_type': 'virtual-router', 'parent_uuid': '7b8a0f32-9a34-40c3-a30c-7cf0b8c81e0e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '66afa5de-92c2-49ab-b27b-257540afe36a', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:66:af:a5:de:92']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '1856d690-810c-462f-a75f-6a8f513dd55a'}]}, 'oper': 'CREATE', 'request-id': 'req-540adecf-ba46-42ad-bf2a-f38f8173c82e', 'type': 'virtual_machine_interface', 'uuid': '66afa5de-92c2-49ab-b27b-257540afe36a'} 06/19/2025 00:56:34.901 7f4a5f042390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3480-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-540adecf-ba46-42ad-bf2a-f38f8173c82e', 'type': 'virtual_machine_interface', 'uuid': '66afa5de-92c2-49ab-b27b-257540afe36a'} 06/19/2025 00:56:34.954 7f4a5f042390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3480-2', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3480-2', 'vhost0'], 'id_perms': {'created': '2025-06-19T00:56:34.937930', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-19T00:56:34.937930', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12954967039054287559, 'uuid_mslong': 17513639920485548542}}, 'parent_type': 'virtual-router', 'parent_uuid': '5037d8f8-aa18-4a69-afec-f4d688782111', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f30cf2b7-68a4-41fe-b3c9-49e237b992c7', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:f3:0c:f2:b7:68']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '1856d690-810c-462f-a75f-6a8f513dd55a'}]}, 'oper': 'CREATE', 'request-id': 'req-70315cbb-8185-421a-af61-2e54e712b794', 'type': 'virtual_machine_interface', 'uuid': 'f30cf2b7-68a4-41fe-b3c9-49e237b992c7'} 06/19/2025 00:56:35.029 7f4a5f042390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3480-2', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-70315cbb-8185-421a-af61-2e54e712b794', 'type': 'virtual_machine_interface', 'uuid': 'f30cf2b7-68a4-41fe-b3c9-49e237b992c7'} 06/19/2025 00:56:35.401 7f4a5f042390 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-7795ad9f-d6f5-4118-b2f3-d052ff90f441', 'type': 'access_control_list', 'uuid': '203056b2-58c7-462f-9002-e792f7d8ed04'} 06/19/2025 00:56:56.712 7f4a6aa53780 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/19/2025 00:57:28.808 7f4a5f0d28d0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/19/2025 01:43:16.295 7f4a5f087438 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map