08/28/2025 04:58:42.657 7fcc342796c8 [contrail-device-manager] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 08/28/2025 04:58:42.657 7fcc342796c8 [contrail-device-manager] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 08/28/2025 04:58:42.657 7fcc342796c8 [contrail-device-manager] [INFO]: SANDESH: Flow Logging: [None] -> [False] 08/28/2025 04:58:42.657 7fcc2b9732e8 [contrail-device-manager] [INFO]: Processing event[EvStart] in state[none] 08/28/2025 04:58:42.657 7fcc2b9732e8 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 08/28/2025 04:58:42.658 7fcc2b9732e8 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 08/28/2025 04:58:42.658 7fcc2b9732e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 08/28/2025 04:58:42.658 7fcc2b9732e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:42.658 7fcc2b9732e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 08/28/2025 04:58:42.658 7fcc2b9732e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:42.658 7fcc2b9732e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:42.658 7fcc2b9732e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 start_time = 1756357122658176 collector_name = collector_ip = collector_list = [ 10.0.0.38:8086, 10.0.0.254:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 08/28/2025 04:58:42.658 7fcc2b9732e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:42.702 7fcc342796c8 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.254:5673//', 'pyamqp://guest:guest@10.0.0.38:5673//', 'pyamqp://guest:guest@10.0.0.48:5673//'] 08/28/2025 04:58:42.711 7fcc342796c8 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 08/28/2025 04:58:42.711 7fcc2b8c2588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:42.712 7fcc2b8c2588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 08/28/2025 04:58:42.712 7fcc2b8c2588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:42.712 7fcc2b8c2588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:42.712 7fcc2b8c2588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 08/28/2025 04:58:42.712 7fcc2b8c2588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:42.715 7fcc342796c8 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 08/28/2025 04:58:42.715 7fcc2b8c2240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:42.715 7fcc2b8c2240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 08/28/2025 04:58:42.715 7fcc2b8c2240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:42.725 7fcc342796c8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 08/28/2025 04:58:42.726 7fcc2b8c20f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:42.726 7fcc2b8c20f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 08/28/2025 04:58:42.726 7fcc2b8c20f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:42.730 7fcc342796c8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 08/28/2025 04:58:42.730 7fcc3a174978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:42.730 7fcc3a174978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 08/28/2025 04:58:42.730 7fcc3a174978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:42.743 7fcc342796c8 [contrail-device-manager] [DEBUG]: Removed remaining AMQP queue from previous run 08/28/2025 04:58:42.743 7fcc342796c8 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 08/28/2025 04:58:42.743 7fcc342796c8 [contrail-device-manager] [WARNING]: initializing cassandra cluster 08/28/2025 04:58:42.744 7fcc342796c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 08/28/2025 04:58:42.744 7fcc311fa6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting consumer greenlet 08/28/2025 04:58:42.744 7fcc311fa6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 08/28/2025 04:58:42.744 7fcc2e109978 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting publisher greenlet 08/28/2025 04:58:42.744 7fcc2e109978 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Publisher connection 08/28/2025 04:58:42.744 7fcc2b761588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:42.745 7fcc2b761588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 08/28/2025 04:58:42.745 7fcc2b761588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:42.746 7fcc342796c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 08/28/2025 04:58:42.749 7fcc2e109978 [contrail-device-manager] [INFO]: KombuAmqpClient: Publisher connection established 08/28/2025 04:58:42.749 7fcc311fa6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 08/28/2025 04:58:42.749 7fcc311fa6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Waiting for consumer 08/28/2025 04:58:42.786 7fcc342796c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 08/28/2025 04:58:42.787 7fcc2b6fa438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:42.787 7fcc2b6fa438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 08/28/2025 04:58:42.787 7fcc2b6fa438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:42.802 7fcc342796c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 08/28/2025 04:58:42.802 7fcc2b6f7828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:42.802 7fcc2b6f7828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 08/28/2025 04:58:42.803 7fcc2b6f7828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:42.812 7fcc342796c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 08/28/2025 04:58:42.834 7fcc342796c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 08/28/2025 04:58:43.427 7fcc342796c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/28/2025 04:58:43.812 7fcc342796c8 [contrail-device-manager] [WARNING]: table 'obj_uuid_table', created 08/28/2025 04:58:43.816 7fcc342796c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/28/2025 04:58:44.785 7fcc342796c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/28/2025 04:58:46.479 7fcc342796c8 [contrail-device-manager] [WARNING]: table 'obj_uuid_table' fixed with properties {'gc_grace_seconds': 864000} 08/28/2025 04:58:46.483 7fcc342796c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/28/2025 04:58:46.658 7fcc2b638048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/28/2025 04:58:46.660 7fcc2b638048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/28/2025 04:58:46.660 7fcc2b638048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/28/2025 04:58:46.660 7fcc2b638048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:58:46.660 7fcc2b638048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 08/28/2025 04:58:46.660 7fcc2b638048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:58:46.660 7fcc2b638048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/28/2025 04:58:46.660 7fcc2b638048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/28/2025 04:58:46.661 7fcc2b638048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:46.661 7fcc2b638048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 08/28/2025 04:58:46.661 7fcc2b638048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:46.661 7fcc2b638048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:46.661 7fcc2b638048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 start_time = 1756357122658176 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, 10.0.0.254:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/28/2025 04:58:46.661 7fcc2b638048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:48.324 7fcc342796c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/28/2025 04:58:49.066 7fcc342796c8 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table', created 08/28/2025 04:58:49.072 7fcc342796c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/28/2025 04:58:50.661 7fcc2b64a240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/28/2025 04:58:50.662 7fcc2b64a240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/28/2025 04:58:50.662 7fcc2b64a240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/28/2025 04:58:50.662 7fcc2b64a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:58:50.662 7fcc2b64a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 08/28/2025 04:58:50.662 7fcc2b64a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:58:50.662 7fcc2b64a240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/28/2025 04:58:50.663 7fcc2b64a240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/28/2025 04:58:50.663 7fcc2b64a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:50.663 7fcc2b64a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 08/28/2025 04:58:50.663 7fcc2b64a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:50.663 7fcc2b64a240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:50.663 7fcc2b64a240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 start_time = 1756357122658176 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.38:8086, 10.0.0.254:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/28/2025 04:58:50.663 7fcc2b64a240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:50.873 7fcc342796c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/28/2025 04:58:51.778 7fcc342796c8 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table' fixed with properties {'gc_grace_seconds': 864000} 08/28/2025 04:58:51.783 7fcc342796c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/28/2025 04:58:53.712 7fcc342796c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/28/2025 04:58:53.714 7fcc342796c8 [contrail-device-manager] [WARNING]: table 'obj_shared_table', created 08/28/2025 04:58:53.717 7fcc342796c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/28/2025 04:58:54.663 7fcc30f51048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/28/2025 04:58:54.664 7fcc30f51048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/28/2025 04:58:54.665 7fcc30f51048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/28/2025 04:58:54.665 7fcc30f51048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:58:54.665 7fcc30f51048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 08/28/2025 04:58:54.665 7fcc30f51048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:58:54.665 7fcc30f51048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/28/2025 04:58:54.665 7fcc30f51048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/28/2025 04:58:54.665 7fcc30f51048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:54.665 7fcc30f51048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 08/28/2025 04:58:54.665 7fcc30f51048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:54.666 7fcc30f51048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:54.666 7fcc30f51048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 start_time = 1756357122658176 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.38:8086, 10.0.0.254:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/28/2025 04:58:54.666 7fcc30f51048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:55.918 7fcc342796c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/28/2025 04:58:57.416 7fcc342796c8 [contrail-device-manager] [WARNING]: table 'obj_shared_table' fixed with properties {'gc_grace_seconds': 864000} 08/28/2025 04:58:57.421 7fcc342796c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/28/2025 04:58:57.422 7fcc2c5114e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:57.422 7fcc2c5114e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/28/2025 04:58:57.422 7fcc2c5114e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:57.470 7fcc342796c8 [contrail-device-manager] [ERROR]: Error in db walk read 'type' 08/28/2025 04:58:57.471 7fcc2b64b198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:57.471 7fcc2b64b198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Zookeeper:Zookeeper[] connection down >>, ] >> 08/28/2025 04:58:57.471 7fcc2b64b198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:57.482 7fcc2b645198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:57.482 7fcc2b645198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/28/2025 04:58:57.482 7fcc2b645198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:57.483 7fcc342796c8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_status_consumer.dummy 08/28/2025 04:58:57.483 7fcc342796c8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_request_consumer 08/28/2025 04:58:57.483 7fcc311fa6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 08/28/2025 04:58:57.486 7fcc342796c8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3957-1. 08/28/2025 04:58:57.488 7fcc311fa6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 08/28/2025 04:58:57.595 7fcc311fa6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3957-1.'] 08/28/2025 04:58:57.609 7fcc311fa6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 08/28/2025 04:58:57.613 7fcc311fa6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 08/28/2025 04:58:57.655 7fcc311fa6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3957-1.'] 08/28/2025 04:58:57.995 7fcc342796c8 [contrail-device-manager] [DEBUG]: Fetching all containers 08/28/2025 04:58:58.101 7fcc342796c8 [contrail-device-manager] [INFO]: Restarting dnsmasq docker: config_dnsmasq_1 08/28/2025 04:58:58.341 7fcc342796c8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3957-1..config_queue 08/28/2025 04:58:58.342 7fcc342796c8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3957-1..tftp_queue 08/28/2025 04:58:58.666 7fcc2b6f78d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/28/2025 04:58:58.667 7fcc2b6f78d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/28/2025 04:58:58.667 7fcc2b6f78d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/28/2025 04:58:58.667 7fcc2b6f78d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:58:58.667 7fcc2b6f78d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/28/2025 04:58:58.667 7fcc2b6f78d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:58:58.667 7fcc2b6f78d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/28/2025 04:58:58.668 7fcc2b6f78d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/28/2025 04:58:58.668 7fcc2b6f78d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:58.668 7fcc2b6f78d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/28/2025 04:58:58.668 7fcc2b6f78d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:58.668 7fcc2b6f78d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:58.668 7fcc2b6f78d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 start_time = 1756357122658176 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, 10.0.0.254:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/28/2025 04:58:58.668 7fcc2b6f78d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:58.704 7fcc311fa6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 08/28/2025 04:58:58.718 7fcc311fa6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 08/28/2025 04:58:58.843 7fcc342796c8 [contrail-device-manager] [WARNING]: Process 135 prepared to run in Full mode... 08/28/2025 04:58:58.843 7fcc342796c8 [contrail-device-manager] [WARNING]: Elected master Device Manager node. Initializing... 08/28/2025 04:58:58.843 7fcc342796c8 [contrail-device-manager] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8096 08/28/2025 04:58:58.846 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add [config_updater.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/config_updater] to home page 08/28/2025 04:58:58.846 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_ConfigApiUpdateReq] 08/28/2025 04:58:58.847 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add [greenlets.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/greenlets] to home page 08/28/2025 04:58:58.847 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_GreenletObjectReq] 08/28/2025 04:58:58.848 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add [cpuinfo.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/nodeinfo/cpuinfo] to home page 08/28/2025 04:58:58.848 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CpuLoadInfoReq] 08/28/2025 04:58:58.851 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add [dm_introspect.xml:/usr/lib/python3.6/site-packages/device_manager/sandesh/dm_introspect] to home page 08/28/2025 04:58:58.851 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_RoutingInstanceList] 08/28/2025 04:58:58.851 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualNetworkList] 08/28/2025 04:58:58.851 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualMachineInterfaceList] 08/28/2025 04:58:58.852 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalInterfaceList] 08/28/2025 04:58:58.852 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalInterfaceList] 08/28/2025 04:58:58.852 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalRouterList] 08/28/2025 04:58:58.852 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_BgpRouterList] 08/28/2025 04:58:58.852 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalRouterList] 08/28/2025 04:58:58.852 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_InstanceIpList] 08/28/2025 04:58:58.852 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FloatingIpList] 08/28/2025 04:58:58.852 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PortTupleList] 08/28/2025 04:58:58.852 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FeatureFlagList] 08/28/2025 04:58:58.853 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add [sandesh_alarm.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_alarm] to home page 08/28/2025 04:58:58.853 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmCacheRequest] 08/28/2025 04:58:58.853 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmTypesRequest] 08/28/2025 04:58:58.854 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmAckRequest] 08/28/2025 04:58:58.854 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add [sandesh_ctrl.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_ctrl] to home page 08/28/2025 04:58:58.854 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlClientToServer] 08/28/2025 04:58:58.854 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlServerToClient] 08/28/2025 04:58:58.854 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add [sandesh_trace.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_trace] to home page 08/28/2025 04:58:58.854 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceRequest] 08/28/2025 04:58:58.855 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferListRequest] 08/28/2025 04:58:58.855 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceEnableDisableReq] 08/28/2025 04:58:58.855 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufStatusReq] 08/28/2025 04:58:58.855 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferEnableDisableReq] 08/28/2025 04:58:58.856 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add [sandesh_uve.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_uve] to home page 08/28/2025 04:58:58.856 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshMessageStatsReq] 08/28/2025 04:58:58.856 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsSet] 08/28/2025 04:58:58.856 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsStatus] 08/28/2025 04:58:58.856 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsSet] 08/28/2025 04:58:58.856 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsStatus] 08/28/2025 04:58:58.856 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsSet] 08/28/2025 04:58:58.857 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsReset] 08/28/2025 04:58:58.857 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsStatus] 08/28/2025 04:58:58.857 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueSet] 08/28/2025 04:58:58.857 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueStatus] 08/28/2025 04:58:58.857 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CollectorInfoRequest] 08/28/2025 04:58:58.857 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVEDSConfReq] 08/28/2025 04:58:58.857 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVECacheReq] 08/28/2025 04:58:58.857 7fcc342796c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVETypesReq] 08/28/2025 04:58:58.859 7fcc342796c8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.ztp_queue 08/28/2025 04:58:58.863 7fcc2ad08588 [contrail-device-manager] [ERROR]: Cannot write http_port 8096 to /tmp/contrail-device-manager.1.http_port 08/28/2025 04:58:58.863 7fcc2ad08588 [contrail-device-manager] [ERROR]: Starting Introspect on HTTP Port 8096 08/28/2025 04:58:58.939 7fcc2a576978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:58.939 7fcc2a576978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Initializing description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 08/28/2025 04:58:58.939 7fcc2a576978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:58.952 7fcc2a45b438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:58.952 7fcc2a45b438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 08/28/2025 04:58:58.952 7fcc2a45b438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:58:59.045 7fcc311fa6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3957-1.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3957-1..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3957-1..tftp_queue', 'device_manager_ztp.ztp_queue'] 08/28/2025 04:58:59.070 7fcc311fa6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 08/28/2025 04:58:59.079 7fcc311fa6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 08/28/2025 04:58:59.125 7fcc311fa6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3957-1.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3957-1..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3957-1..tftp_queue', 'device_manager_ztp.ztp_queue'] 08/28/2025 04:59:02.075 7fcc2a3b9438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:02.075 7fcc2a3b9438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/28/2025 04:59:02.075 7fcc2a3b9438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:02.668 7fcc2a37aa20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/28/2025 04:59:02.669 7fcc2a37aa20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/28/2025 04:59:02.669 7fcc2a37aa20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/28/2025 04:59:02.669 7fcc2a37aa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:59:02.669 7fcc2a37aa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/28/2025 04:59:02.669 7fcc2a37aa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:59:02.669 7fcc2a37aa20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/28/2025 04:59:02.669 7fcc2a37aa20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/28/2025 04:59:02.670 7fcc2a37aa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:02.670 7fcc2a37aa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/28/2025 04:59:02.670 7fcc2a37aa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:02.670 7fcc2a37aa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:02.670 7fcc2a37aa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1756357122658176 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.38:8086, 10.0.0.254:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/28/2025 04:59:02.670 7fcc2a37aa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:06.694 7fcc2a2fe048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/28/2025 04:59:06.708 7fcc2a2fe048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/28/2025 04:59:06.708 7fcc2a2fe048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/28/2025 04:59:06.708 7fcc2a2fe048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:59:06.708 7fcc2a2fe048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/28/2025 04:59:06.708 7fcc2a2fe048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:59:06.708 7fcc2a2fe048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/28/2025 04:59:06.709 7fcc2a2fe048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/28/2025 04:59:06.709 7fcc2a2fe048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:06.709 7fcc2a2fe048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/28/2025 04:59:06.709 7fcc2a2fe048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:06.709 7fcc2a2fe048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:06.709 7fcc2a2fe048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1756357122658176 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.38:8086, 10.0.0.254:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/28/2025 04:59:06.709 7fcc2a2fe048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:10.708 7fcc2a316630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/28/2025 04:59:10.713 7fcc2a316630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/28/2025 04:59:10.713 7fcc2a316630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/28/2025 04:59:10.713 7fcc2a316630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:59:10.713 7fcc2a316630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/28/2025 04:59:10.713 7fcc2a316630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:59:10.713 7fcc2a316630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/28/2025 04:59:10.714 7fcc2a316630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/28/2025 04:59:10.714 7fcc2a316630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:10.714 7fcc2a316630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/28/2025 04:59:10.714 7fcc2a316630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:10.714 7fcc2a316630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:10.714 7fcc2a316630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1756357122658176 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, 10.0.0.254:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/28/2025 04:59:10.714 7fcc2a316630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:14.713 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/28/2025 04:59:14.714 7fcc2b66b048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/28/2025 04:59:14.714 7fcc2b66b048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/28/2025 04:59:14.714 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:59:14.714 7fcc2b66b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/28/2025 04:59:14.714 7fcc2b66b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:59:14.714 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/28/2025 04:59:14.715 7fcc2b66b048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/28/2025 04:59:14.715 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:14.715 7fcc2b66b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/28/2025 04:59:14.715 7fcc2b66b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:14.715 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:14.715 7fcc2b66b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1756357122658176 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.38:8086, 10.0.0.254:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/28/2025 04:59:14.715 7fcc2b66b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:18.715 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/28/2025 04:59:18.716 7fcc2b66b048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/28/2025 04:59:18.716 7fcc2b66b048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/28/2025 04:59:18.717 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:59:18.717 7fcc2b66b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/28/2025 04:59:18.717 7fcc2b66b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:59:18.717 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/28/2025 04:59:18.717 7fcc2b66b048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/28/2025 04:59:18.717 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:18.717 7fcc2b66b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/28/2025 04:59:18.717 7fcc2b66b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:18.717 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:18.718 7fcc2b66b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1756357122658176 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.38:8086, 10.0.0.254:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/28/2025 04:59:18.718 7fcc2b66b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:22.717 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/28/2025 04:59:22.719 7fcc2b66b048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/28/2025 04:59:22.719 7fcc2b66b048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/28/2025 04:59:22.719 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:59:22.719 7fcc2b66b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/28/2025 04:59:22.719 7fcc2b66b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:59:22.719 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/28/2025 04:59:22.719 7fcc2b66b048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/28/2025 04:59:22.719 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:22.720 7fcc2b66b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/28/2025 04:59:22.720 7fcc2b66b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:22.720 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:22.720 7fcc2b66b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1756357122658176 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, 10.0.0.254:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/28/2025 04:59:22.720 7fcc2b66b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:26.719 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/28/2025 04:59:26.720 7fcc2b66b048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/28/2025 04:59:26.721 7fcc2b66b048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/28/2025 04:59:26.721 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:59:26.721 7fcc2b66b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/28/2025 04:59:26.721 7fcc2b66b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:59:26.721 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/28/2025 04:59:26.721 7fcc2b66b048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/28/2025 04:59:26.721 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:26.721 7fcc2b66b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/28/2025 04:59:26.721 7fcc2b66b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:26.721 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:26.722 7fcc2b66b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1756357122658176 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.38:8086, 10.0.0.254:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/28/2025 04:59:26.722 7fcc2b66b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:30.722 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/28/2025 04:59:30.723 7fcc2b66b048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/28/2025 04:59:30.723 7fcc2b66b048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/28/2025 04:59:30.723 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:59:30.723 7fcc2b66b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/28/2025 04:59:30.723 7fcc2b66b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:59:30.723 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/28/2025 04:59:30.724 7fcc2b66b048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/28/2025 04:59:30.724 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:30.724 7fcc2b66b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/28/2025 04:59:30.724 7fcc2b66b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:30.724 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:30.724 7fcc2b66b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1756357122658176 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.38:8086, 10.0.0.254:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/28/2025 04:59:30.724 7fcc2b66b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:34.724 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/28/2025 04:59:34.725 7fcc2b66b048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/28/2025 04:59:34.725 7fcc2b66b048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/28/2025 04:59:34.725 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:59:34.725 7fcc2b66b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/28/2025 04:59:34.725 7fcc2b66b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:59:34.726 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/28/2025 04:59:34.726 7fcc2b66b048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/28/2025 04:59:34.726 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:34.726 7fcc2b66b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/28/2025 04:59:34.726 7fcc2b66b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:34.726 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:34.726 7fcc2b66b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1756357122658176 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, 10.0.0.254:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/28/2025 04:59:34.726 7fcc2b66b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:38.726 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/28/2025 04:59:38.727 7fcc2b66b048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/28/2025 04:59:38.727 7fcc2b66b048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/28/2025 04:59:38.727 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:59:38.727 7fcc2b66b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/28/2025 04:59:38.727 7fcc2b66b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:59:38.727 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/28/2025 04:59:38.728 7fcc2b66b048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/28/2025 04:59:38.728 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:38.728 7fcc2b66b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/28/2025 04:59:38.728 7fcc2b66b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:38.728 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:38.728 7fcc2b66b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1756357122658176 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.38:8086, 10.0.0.254:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/28/2025 04:59:38.728 7fcc2b66b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:42.728 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/28/2025 04:59:42.729 7fcc2b66b048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/28/2025 04:59:42.730 7fcc2b66b048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/28/2025 04:59:42.730 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:59:42.730 7fcc2b66b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/28/2025 04:59:42.730 7fcc2b66b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:59:42.730 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/28/2025 04:59:42.730 7fcc2b66b048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/28/2025 04:59:42.730 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:42.730 7fcc2b66b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/28/2025 04:59:42.730 7fcc2b66b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:42.731 7fcc2b66b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:42.731 7fcc2b66b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1756357122658176 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.38:8086, 10.0.0.254:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/28/2025 04:59:42.731 7fcc2b66b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:46.730 7fcc2b67b588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/28/2025 04:59:46.732 7fcc2b67b588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/28/2025 04:59:46.732 7fcc2b67b588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/28/2025 04:59:46.732 7fcc2b67b588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:59:46.732 7fcc2b67b588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/28/2025 04:59:46.732 7fcc2b67b588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:59:46.732 7fcc2b67b588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/28/2025 04:59:46.732 7fcc2b67b588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/28/2025 04:59:46.732 7fcc2b67b588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:46.733 7fcc2b67b588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/28/2025 04:59:46.733 7fcc2b67b588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:46.733 7fcc2b67b588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:46.733 7fcc2b67b588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1756357122658176 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, 10.0.0.254:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/28/2025 04:59:46.733 7fcc2b67b588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:50.733 7fcc2b6d2f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/28/2025 04:59:50.734 7fcc2b6d2f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/28/2025 04:59:50.734 7fcc2b6d2f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/28/2025 04:59:50.734 7fcc2b6d2f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:59:50.734 7fcc2b6d2f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/28/2025 04:59:50.734 7fcc2b6d2f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:59:50.734 7fcc2b6d2f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/28/2025 04:59:50.735 7fcc2b6d2f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/28/2025 04:59:50.735 7fcc2b6d2f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:50.735 7fcc2b6d2f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/28/2025 04:59:50.735 7fcc2b6d2f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:50.735 7fcc2b6d2f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:50.735 7fcc2b6d2f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1756357122658176 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.38:8086, 10.0.0.254:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/28/2025 04:59:50.735 7fcc2b6d2f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:54.734 7fcc2b67b198 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/28/2025 04:59:54.735 7fcc2b67b198 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/28/2025 04:59:54.735 7fcc2b67b198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/28/2025 04:59:54.735 7fcc2b67b198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:59:54.735 7fcc2b67b198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/28/2025 04:59:54.736 7fcc2b67b198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:59:54.736 7fcc2b67b198 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/28/2025 04:59:54.736 7fcc2b67b198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/28/2025 04:59:54.736 7fcc2b67b198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:54.736 7fcc2b67b198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/28/2025 04:59:54.736 7fcc2b67b198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:54.736 7fcc2b67b198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:54.736 7fcc2b67b198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1756357122658176 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.38:8086, 10.0.0.254:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/28/2025 04:59:54.736 7fcc2b67b198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:58.736 7fcc2b67b048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/28/2025 04:59:58.738 7fcc2b67b048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/28/2025 04:59:58.738 7fcc2b67b048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/28/2025 04:59:58.738 7fcc2b67b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:59:58.738 7fcc2b67b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/28/2025 04:59:58.738 7fcc2b67b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/28/2025 04:59:58.738 7fcc2b67b048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/28/2025 04:59:58.738 7fcc2b67b048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/28/2025 04:59:58.738 7fcc2b67b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:58.739 7fcc2b67b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/28/2025 04:59:58.739 7fcc2b67b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:58.739 7fcc2b67b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 04:59:58.739 7fcc2b67b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1756357122658176 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, 10.0.0.254:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/28/2025 04:59:58.739 7fcc2b67b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:02.739 7fcc2a384390 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/28/2025 05:00:02.742 7fcc2a384390 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/28/2025 05:00:02.742 7fcc2a384390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/28/2025 05:00:02.742 7fcc2a384390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/28/2025 05:00:02.742 7fcc2a384390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/28/2025 05:00:02.742 7fcc2a384390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/28/2025 05:00:02.742 7fcc2a384390 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/28/2025 05:00:02.743 7fcc2a384390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/28/2025 05:00:02.743 7fcc2a384390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:02.743 7fcc2a384390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/28/2025 05:00:02.743 7fcc2a384390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:02.743 7fcc2a384390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:02.743 7fcc2a384390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1756357122658176 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.38:8086, 10.0.0.254:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/28/2025 05:00:02.743 7fcc2a384390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:06.742 7fcc2b761a20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/28/2025 05:00:06.743 7fcc2b761a20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/28/2025 05:00:06.744 7fcc2b761a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/28/2025 05:00:06.744 7fcc2b761a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/28/2025 05:00:06.744 7fcc2b761a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/28/2025 05:00:06.744 7fcc2b761a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/28/2025 05:00:06.744 7fcc2b761a20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/28/2025 05:00:06.744 7fcc2b761a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/28/2025 05:00:06.744 7fcc2b761a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:06.744 7fcc2b761a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/28/2025 05:00:06.744 7fcc2b761a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:06.744 7fcc2b761a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:06.744 7fcc2b761a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1756357122658176 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.38:8086, 10.0.0.254:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/28/2025 05:00:06.745 7fcc2b761a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:10.744 7fcc2ad42780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/28/2025 05:00:10.746 7fcc2ad42780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/28/2025 05:00:10.746 7fcc2ad42780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/28/2025 05:00:10.747 7fcc2ad42780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/28/2025 05:00:10.747 7fcc2ad42780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/28/2025 05:00:10.747 7fcc2ad42780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/28/2025 05:00:10.747 7fcc2ad42780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/28/2025 05:00:10.748 7fcc2ad42780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/28/2025 05:00:10.748 7fcc2ad42780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:10.748 7fcc2ad42780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/28/2025 05:00:10.748 7fcc2ad42780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:10.748 7fcc2ad42780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:10.748 7fcc2ad42780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1756357122658176 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, 10.0.0.254:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/28/2025 05:00:10.748 7fcc2ad42780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:14.752 7fcc2a44a4e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/28/2025 05:00:14.753 7fcc2a44a4e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/28/2025 05:00:14.753 7fcc2a44a4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/28/2025 05:00:14.753 7fcc2a44a4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/28/2025 05:00:14.753 7fcc2a44a4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/28/2025 05:00:14.754 7fcc2a44a4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/28/2025 05:00:14.754 7fcc2a44a4e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/28/2025 05:00:14.754 7fcc2a44a4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/28/2025 05:00:14.754 7fcc2a44a4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:14.754 7fcc2a44a4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/28/2025 05:00:14.754 7fcc2a44a4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:14.754 7fcc2a44a4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:14.754 7fcc2a44a4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1756357122658176 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.38:8086, 10.0.0.254:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/28/2025 05:00:14.754 7fcc2a44a4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:18.759 7fcc2a44a438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/28/2025 05:00:18.763 7fcc2a44a438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/28/2025 05:00:18.763 7fcc2a44a438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/28/2025 05:00:18.763 7fcc2a44a438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/28/2025 05:00:18.763 7fcc2a44a438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/28/2025 05:00:18.763 7fcc2a44a438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/28/2025 05:00:18.763 7fcc2a44a438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/28/2025 05:00:18.764 7fcc2a44a438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/28/2025 05:00:18.764 7fcc2a44a438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:18.764 7fcc2a44a438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/28/2025 05:00:18.764 7fcc2a44a438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:18.764 7fcc2a44a438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:18.764 7fcc2a44a438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1756357122658176 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.38:8086, 10.0.0.254:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/28/2025 05:00:18.764 7fcc2a44a438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:19.311 7fcc342796c8 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 08/28/2025 05:00:19.311 7fcc342796c8 [contrail-device-manager] [WARNING]: initializing cassandra cluster 08/28/2025 05:00:19.312 7fcc342796c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 08/28/2025 05:00:19.312 7fcc31421438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:19.312 7fcc31421438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 08/28/2025 05:00:19.312 7fcc31421438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:19.316 7fcc342796c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 08/28/2025 05:00:19.363 7fcc342796c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 08/28/2025 05:00:19.364 7fcc2a3b08d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:19.364 7fcc2a3b08d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Initializing description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 08/28/2025 05:00:19.364 7fcc2a3b08d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:19.371 7fcc342796c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 08/28/2025 05:00:19.371 7fcc2a3b06d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:19.371 7fcc2a3b06d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 08/28/2025 05:00:19.371 7fcc2a3b06d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:19.382 7fcc342796c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/28/2025 05:00:19.886 7fcc342796c8 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace', created 08/28/2025 05:00:19.890 7fcc342796c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/28/2025 05:00:19.896 7fcc342796c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/28/2025 05:00:20.753 7fcc342796c8 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None} 08/28/2025 05:00:20.758 7fcc342796c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/28/2025 05:00:20.758 7fcc342796c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 08/28/2025 05:00:20.818 7fcc342796c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 08/28/2025 05:00:20.832 7fcc342796c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/28/2025 05:00:21.776 7fcc342796c8 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table', created 08/28/2025 05:00:21.781 7fcc342796c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/28/2025 05:00:21.788 7fcc342796c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/28/2025 05:00:22.501 7fcc342796c8 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table' fixed with properties {'gc_grace_seconds': 864000} 08/28/2025 05:00:22.509 7fcc342796c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/28/2025 05:00:22.522 7fcc342796c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/28/2025 05:00:22.765 7fcc2a360c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/28/2025 05:00:22.767 7fcc2a360c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/28/2025 05:00:22.771 7fcc2a360c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/28/2025 05:00:22.771 7fcc2a360c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/28/2025 05:00:22.771 7fcc2a360c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 08/28/2025 05:00:22.771 7fcc2a360c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/28/2025 05:00:22.771 7fcc2a360c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/28/2025 05:00:22.772 7fcc2a360c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/28/2025 05:00:22.775 7fcc2a360c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:22.775 7fcc2a360c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 08/28/2025 05:00:22.775 7fcc2a360c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:22.775 7fcc2a360c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:22.775 7fcc2a360c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1756357122658176 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, 10.0.0.254:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/28/2025 05:00:22.775 7fcc2a360c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:23.034 7fcc342796c8 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table', created 08/28/2025 05:00:23.040 7fcc342796c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/28/2025 05:00:23.047 7fcc342796c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/28/2025 05:00:23.742 7fcc342796c8 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table' fixed with properties {'gc_grace_seconds': 864000} 08/28/2025 05:00:23.746 7fcc342796c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/28/2025 05:00:23.761 7fcc342796c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/28/2025 05:00:24.546 7fcc342796c8 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table', created 08/28/2025 05:00:24.562 7fcc342796c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/28/2025 05:00:24.594 7fcc342796c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/28/2025 05:00:25.885 7fcc342796c8 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table' fixed with properties {'gc_grace_seconds': 864000} 08/28/2025 05:00:25.888 7fcc342796c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/28/2025 05:00:25.893 7fcc342796c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/28/2025 05:00:26.768 7fcc2a366b70 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/28/2025 05:00:26.769 7fcc2a366b70 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/28/2025 05:00:26.769 7fcc2a366b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/28/2025 05:00:26.769 7fcc2a366b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/28/2025 05:00:26.769 7fcc2a366b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 08/28/2025 05:00:26.769 7fcc2a366b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/28/2025 05:00:26.769 7fcc2a366b70 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/28/2025 05:00:26.770 7fcc2a366b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/28/2025 05:00:26.770 7fcc2a366b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:26.770 7fcc2a366b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 08/28/2025 05:00:26.770 7fcc2a366b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:26.770 7fcc2a366b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:26.770 7fcc2a366b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1756357122658176 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.38:8086, 10.0.0.254:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/28/2025 05:00:26.770 7fcc2a366b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:26.808 7fcc342796c8 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table', created 08/28/2025 05:00:26.816 7fcc342796c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/28/2025 05:00:26.842 7fcc342796c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/28/2025 05:00:27.943 7fcc342796c8 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table' fixed with properties {'gc_grace_seconds': 864000} 08/28/2025 05:00:27.947 7fcc342796c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/28/2025 05:00:27.948 7fcc2a30df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:27.948 7fcc2a30df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/28/2025 05:00:27.948 7fcc2a30df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:27.987 7fcc342796c8 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.254:5673//', 'pyamqp://guest:guest@10.0.0.38:5673//', 'pyamqp://guest:guest@10.0.0.48:5673//'] 08/28/2025 05:00:27.988 7fcc342796c8 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 08/28/2025 05:00:27.988 7fcc2f134eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:27.988 7fcc2f134eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Initializing description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 08/28/2025 05:00:27.988 7fcc2f134eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:27.988 7fcc2f134eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:27.988 7fcc2f134eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 08/28/2025 05:00:27.988 7fcc2f134eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:27.992 7fcc2a2e0438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:27.993 7fcc2a2e0438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/28/2025 05:00:27.993 7fcc2a2e0438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:27.994 7fcc342796c8 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 08/28/2025 05:00:28.030 7fcc342796c8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 08/28/2025 05:00:28.031 7fcc2a3b06d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:28.031 7fcc2a3b06d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 08/28/2025 05:00:28.031 7fcc2a3b06d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:28.040 7fcc342796c8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 08/28/2025 05:00:28.040 7fcc2a3b06d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:28.040 7fcc2a3b06d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/28/2025 05:00:28.040 7fcc2a3b06d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:28.041 7fcc2a519588 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 08/28/2025 05:00:28.042 7fcc2a3602e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:28.042 7fcc2a3602e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 08/28/2025 05:00:28.042 7fcc2a3602e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:28.046 7fcc2a519588 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 08/28/2025 05:00:28.046 7fcc2a35ba20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:28.046 7fcc2a35ba20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/28/2025 05:00:28.046 7fcc2a35ba20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:30.771 7fcc31ccc780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/28/2025 05:00:30.772 7fcc31ccc780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/28/2025 05:00:30.773 7fcc31ccc780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/28/2025 05:00:30.773 7fcc31ccc780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/28/2025 05:00:30.773 7fcc31ccc780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/28/2025 05:00:30.773 7fcc31ccc780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/28/2025 05:00:30.773 7fcc31ccc780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/28/2025 05:00:30.773 7fcc31ccc780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/28/2025 05:00:30.773 7fcc31ccc780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:30.774 7fcc31ccc780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/28/2025 05:00:30.774 7fcc31ccc780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:30.774 7fcc31ccc780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:30.774 7fcc31ccc780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1756357122658176 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.38:8086, 10.0.0.254:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/28/2025 05:00:30.774 7fcc31ccc780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:34.774 7fcc31ccc780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/28/2025 05:00:34.775 7fcc31ccc780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/28/2025 05:00:34.775 7fcc31ccc780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/28/2025 05:00:34.775 7fcc31ccc780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/28/2025 05:00:34.775 7fcc31ccc780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/28/2025 05:00:34.775 7fcc31ccc780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/28/2025 05:00:34.775 7fcc31ccc780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/28/2025 05:00:34.776 7fcc31ccc780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/28/2025 05:00:34.776 7fcc31ccc780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:34.776 7fcc31ccc780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/28/2025 05:00:34.776 7fcc31ccc780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:34.776 7fcc31ccc780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:34.776 7fcc31ccc780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1756357122658176 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.38:8086, 10.0.0.254:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/28/2025 05:00:34.776 7fcc31ccc780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:38.776 7fcc31ccc780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/28/2025 05:00:38.777 7fcc31ccc780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/28/2025 05:00:38.777 7fcc31ccc780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/28/2025 05:00:38.777 7fcc31ccc780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/28/2025 05:00:38.777 7fcc31ccc780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/28/2025 05:00:38.777 7fcc31ccc780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/28/2025 05:00:38.777 7fcc31ccc780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/28/2025 05:00:38.777 7fcc31ccc780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/28/2025 05:00:38.778 7fcc31ccc780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:38.778 7fcc31ccc780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/28/2025 05:00:38.778 7fcc31ccc780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:38.778 7fcc31ccc780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:38.778 7fcc31ccc780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1756357122658176 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.38:8086, 10.0.0.254:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/28/2025 05:00:38.778 7fcc31ccc780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/28/2025 05:00:41.604 7fcc2a3b06d8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3957-1.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.254', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3957-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3957-1.'], 'id_perms': {'created': '2025-08-28T05:00:41.591653', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-28T05:00:41.591653', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13355403330741171144, 'uuid_mslong': 4952518174609984319}}, 'parent_type': 'global-system-config', 'parent_uuid': 'f1b6c129-6adf-442a-a7ea-8b31cf9a4856', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '44bae10a-4d4b-4b3f-b957-ec91c0e573c8'}, 'oper': 'CREATE', 'request-id': 'req-541c7f0b-2075-426d-a376-97eee693ee7f', 'type': 'analytics_node', 'uuid': '44bae10a-4d4b-4b3f-b957-ec91c0e573c8'} 08/28/2025 05:00:41.629 7fcc2a3b06d8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3957-3.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.48', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3957-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3957-3.'], 'id_perms': {'created': '2025-08-28T05:00:41.621920', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-28T05:00:41.621920', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13184919377043911601, 'uuid_mslong': 9486943273330034351}}, 'parent_type': 'global-system-config', 'parent_uuid': 'f1b6c129-6adf-442a-a7ea-8b31cf9a4856', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '83a864a4-a31e-46af-b6fa-3e5114ddf3b1'}, 'oper': 'CREATE', 'request-id': 'req-1240cde5-6a5c-40b4-a05c-cc457e48d2e7', 'type': 'analytics_node', 'uuid': '83a864a4-a31e-46af-b6fa-3e5114ddf3b1'} 08/28/2025 05:00:41.649 7fcc2a3b06d8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3957-2.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.38', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3957-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3957-2.'], 'id_perms': {'created': '2025-08-28T05:00:41.623011', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-28T05:00:41.623011', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12421588130269131423, 'uuid_mslong': 12994564413355280412}}, 'parent_type': 'global-system-config', 'parent_uuid': 'f1b6c129-6adf-442a-a7ea-8b31cf9a4856', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b455f77c-5cf9-481c-ac62-589792e6729f'}, 'oper': 'CREATE', 'request-id': 'req-65bc1973-7f31-48ec-a31f-d31009ad212f', 'type': 'analytics_node', 'uuid': 'b455f77c-5cf9-481c-ac62-589792e6729f'} 08/28/2025 05:00:42.779 7fcc2a369d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/28/2025 05:00:42.785 7fcc2a369d68 [contrail-device-manager] [INFO]: Session Event: TCP Connected 08/28/2025 05:00:42.785 7fcc2a369d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/28/2025 05:00:42.786 7fcc2a369d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/28/2025 05:00:42.786 7fcc2a369d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3957-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/28/2025 05:00:42.786 7fcc2a369d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/28/2025 05:00:42.786 7fcc2a369d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnected] in state[Connect] 08/28/2025 05:00:42.786 7fcc2a369d68 [contrail-device-manager] [DEBUG]: Send sandesh control message. uve type count # 19 08/28/2025 05:00:42.787 7fcc2a369d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 08/28/2025 05:00:42.787 7fcc2a369d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 08/28/2025 05:00:42.787 7fcc2a369d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 08/28/2025 05:00:42.788 7fcc2a26eb70 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 08/28/2025 05:00:42.789 7fcc2a26eb70 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 08/28/2025 05:00:51.375 7fcc2b660828 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001016 08/28/2025 05:00:51.375 7fcc2b660828 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 08/28/2025 05:00:51.376 7fcc2a3f8978 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 08/28/2025 05:00:51.376 7fcc2a3f8978 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 0 08/28/2025 05:00:51.376 7fcc2a3f8978 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/28/2025 05:00:51.376 7fcc2a3f8978 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 08/28/2025 05:00:51.376 7fcc2a3f8978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 08/28/2025 05:00:51.376 7fcc2a26e828 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 08/28/2025 05:00:51.377 7fcc2a26e828 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 08/28/2025 05:00:55.289 7fcc2a3b06d8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3957-2.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.38', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3957-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3957-2.'], 'id_perms': {'created': '2025-08-28T05:00:55.277831', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-28T05:00:55.277831', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9387600107618150978, 'uuid_mslong': 4159395696428403951}}, 'parent_type': 'global-system-config', 'parent_uuid': 'f1b6c129-6adf-442a-a7ea-8b31cf9a4856', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '39b92459-35e7-4cef-8247-748f6bffaa42'}, 'oper': 'CREATE', 'request-id': 'req-a9d9627a-bb0f-40c3-a945-f1d2b700459a', 'type': 'analytics_alarm_node', 'uuid': '39b92459-35e7-4cef-8247-748f6bffaa42'} 08/28/2025 05:00:55.342 7fcc2a3b06d8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3957-3.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.48', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3957-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3957-3.'], 'id_perms': {'created': '2025-08-28T05:00:55.326635', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-28T05:00:55.326635', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12687229414270579033, 'uuid_mslong': 14366948839665714600}}, 'parent_type': 'global-system-config', 'parent_uuid': 'f1b6c129-6adf-442a-a7ea-8b31cf9a4856', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c761a7d9-ae7c-45a8-b012-17eeb57c3159'}, 'oper': 'CREATE', 'request-id': 'req-77ea7a60-3ee7-4d6f-9581-361ea2417dfa', 'type': 'analytics_alarm_node', 'uuid': 'c761a7d9-ae7c-45a8-b012-17eeb57c3159'} 08/28/2025 05:00:55.368 7fcc2a3b06d8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3957-1.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.254', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3957-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3957-1.'], 'id_perms': {'created': '2025-08-28T05:00:55.347055', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-28T05:00:55.347055', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13571847290594464846, 'uuid_mslong': 16812812805989680245}}, 'parent_type': 'global-system-config', 'parent_uuid': 'f1b6c129-6adf-442a-a7ea-8b31cf9a4856', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e9531c2b-4027-4475-bc58-e3343dbb144e'}, 'oper': 'CREATE', 'request-id': 'req-d59bcaca-72f4-4983-9f3e-c213b1beeb3a', 'type': 'analytics_alarm_node', 'uuid': 'e9531c2b-4027-4475-bc58-e3343dbb144e'} 08/28/2025 05:01:01.355 7fcc2b660828 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001296 08/28/2025 05:01:01.355 7fcc2b660828 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 08/28/2025 05:01:01.356 7fcc2b628f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 08/28/2025 05:01:01.356 7fcc2b628f60 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 2 08/28/2025 05:01:01.356 7fcc2b628f60 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/28/2025 05:01:01.356 7fcc2b628f60 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 08/28/2025 05:01:04.345 7fcc2a3b06d8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3957-2.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.38', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3957-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3957-2.'], 'id_perms': {'created': '2025-08-28T05:01:04.329945', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-28T05:01:04.329945', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10083385424636537147, 'uuid_mslong': 5768626876151644626}}, 'parent_type': 'global-system-config', 'parent_uuid': 'f1b6c129-6adf-442a-a7ea-8b31cf9a4856', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '500e4794-92ca-41d2-8bef-619ea0cfe93b'}, 'oper': 'CREATE', 'request-id': 'req-cb8aad27-ff77-4c3a-ad68-36c5a7cb99bd', 'type': 'analytics_snmp_node', 'uuid': '500e4794-92ca-41d2-8bef-619ea0cfe93b'} 08/28/2025 05:01:04.400 7fcc2a3b06d8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3957-3.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.48', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3957-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3957-3.'], 'id_perms': {'created': '2025-08-28T05:01:04.391795', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-28T05:01:04.391795', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13037971812197813566, 'uuid_mslong': 7068049934990196842}}, 'parent_type': 'global-system-config', 'parent_uuid': 'f1b6c129-6adf-442a-a7ea-8b31cf9a4856', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6216c1f7-bdd0-406a-b4f0-2e48f99b4d3e'}, 'oper': 'CREATE', 'request-id': 'req-b583864a-158c-486b-b52b-f1916ae29d86', 'type': 'analytics_snmp_node', 'uuid': '6216c1f7-bdd0-406a-b4f0-2e48f99b4d3e'} 08/28/2025 05:01:04.471 7fcc2a3b06d8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3957-1.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.254', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3957-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3957-1.'], 'id_perms': {'created': '2025-08-28T05:01:04.461614', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-28T05:01:04.461614', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11295466285992138944, 'uuid_mslong': 12639455953850680217}}, 'parent_type': 'global-system-config', 'parent_uuid': 'f1b6c129-6adf-442a-a7ea-8b31cf9a4856', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'af685e39-2b77-4399-9cc1-8ebdbcf658c0'}, 'oper': 'CREATE', 'request-id': 'req-1495b7a6-279a-4511-841a-de732beb886f', 'type': 'analytics_snmp_node', 'uuid': 'af685e39-2b77-4399-9cc1-8ebdbcf658c0'} 08/28/2025 05:02:45.763 7fcc2a3b06d8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-06f9ae25-a273-4e35-93f0-7002687fbcb6', 'type': 'global_system_config', 'uuid': 'f1b6c129-6adf-442a-a7ea-8b31cf9a4856'} 08/28/2025 05:02:45.894 7fcc2a3b06d8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3957-2'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-3957-2', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3957-2'], 'id_perms': {'created': '2025-08-28T05:02:45.883299', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-28T05:02:45.883299', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10709053969626046395, 'uuid_mslong': 8237580011839178516}}, 'parent_type': 'global-system-config', 'parent_uuid': 'f1b6c129-6adf-442a-a7ea-8b31cf9a4856', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7251c360-4e88-4714-949e-33d8ac0c1fbb', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.193'}, 'oper': 'CREATE', 'request-id': 'req-090cdd6c-f6bf-481d-9915-6a6899664898', 'type': 'virtual_router', 'uuid': '7251c360-4e88-4714-949e-33d8ac0c1fbb'} 08/28/2025 05:02:46.237 7fcc2a3b06d8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3957-2', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3957-2', 'vhost0'], 'id_perms': {'created': '2025-08-28T05:02:46.221176', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-28T05:02:46.221176', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11827326821512258072, 'uuid_mslong': 4224059014292129794}}, 'parent_type': 'virtual-router', 'parent_uuid': '7251c360-4e88-4714-949e-33d8ac0c1fbb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3a9edf4b-212b-4802-a423-1b148eb02218', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:3a:9e:df:4b:21']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '62eb3a60-a239-478a-bfa2-58364da90b10'}]}, 'oper': 'CREATE', 'request-id': 'req-fe163581-a88b-497a-be26-3d262d0a8e2d', 'type': 'virtual_machine_interface', 'uuid': '3a9edf4b-212b-4802-a423-1b148eb02218'} 08/28/2025 05:02:46.304 7fcc2a3b06d8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3957-2', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-fe163581-a88b-497a-be26-3d262d0a8e2d', 'type': 'virtual_machine_interface', 'uuid': '3a9edf4b-212b-4802-a423-1b148eb02218'} 08/28/2025 05:02:46.776 7fcc2a3b06d8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-8590d76f-dc9e-454a-afde-f820f3371569', 'type': 'access_control_list', 'uuid': '6afeb480-fef5-48fa-be19-0e90a8b69f42'} 08/28/2025 05:02:46.856 7fcc2a3b06d8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3957-1'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-3957-1', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3957-1'], 'id_perms': {'created': '2025-08-28T05:02:46.849589', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-28T05:02:46.849589', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10030581862153411345, 'uuid_mslong': 18398883457121469706}}, 'parent_type': 'global-system-config', 'parent_uuid': 'f1b6c129-6adf-442a-a7ea-8b31cf9a4856', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ff55f705-d589-450a-8b33-c90f30215b11', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.25'}, 'oper': 'CREATE', 'request-id': 'req-983f1bea-fd31-478b-88b5-7cf249a24895', 'type': 'virtual_router', 'uuid': 'ff55f705-d589-450a-8b33-c90f30215b11'} 08/28/2025 05:02:47.237 7fcc2a3b06d8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3957-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3957-1', 'vhost0'], 'id_perms': {'created': '2025-08-28T05:02:47.215087', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-28T05:02:47.215087', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10335245647605287303, 'uuid_mslong': 1539278949064329988}}, 'parent_type': 'virtual-router', 'parent_uuid': 'ff55f705-d589-450a-8b33-c90f30215b11', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '155c9e0c-7937-4b04-8f6e-2b2873ea4987', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:15:5c:9e:0c:79']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '62eb3a60-a239-478a-bfa2-58364da90b10'}]}, 'oper': 'CREATE', 'request-id': 'req-1e8f2055-b00b-41d9-98b2-4c2f6047d621', 'type': 'virtual_machine_interface', 'uuid': '155c9e0c-7937-4b04-8f6e-2b2873ea4987'} 08/28/2025 05:02:47.299 7fcc2a3b06d8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3957-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-1e8f2055-b00b-41d9-98b2-4c2f6047d621', 'type': 'virtual_machine_interface', 'uuid': '155c9e0c-7937-4b04-8f6e-2b2873ea4987'} 08/28/2025 05:03:01.259 7fcc313dcc18 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/28/2025 05:03:38.546 7fcc2a34ea20 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/28/2025 05:04:54.953 7fcc2a364a20 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map