12/01/2025 05:22:53.413 7f44c2241e88 [contrail-device-manager] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 12/01/2025 05:22:53.413 7f44c2241e88 [contrail-device-manager] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 12/01/2025 05:22:53.413 7f44c2241e88 [contrail-device-manager] [INFO]: SANDESH: Flow Logging: [None] -> [False] 12/01/2025 05:22:53.414 7f44b9925048 [contrail-device-manager] [INFO]: Processing event[EvStart] in state[none] 12/01/2025 05:22:53.414 7f44b9925048 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 12/01/2025 05:22:53.415 7f44b9925048 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 12/01/2025 05:22:53.415 7f44b9925048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 12/01/2025 05:22:53.415 7f44b9925048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:22:53.415 7f44b9925048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 12/01/2025 05:22:53.415 7f44b9925048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:22:53.415 7f44b9925048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:22:53.415 7f44b9925048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 start_time = 1764566573415136 collector_name = collector_ip = collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 12/01/2025 05:22:53.416 7f44b9925048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:22:53.472 7f44c2241e88 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.50:5673//', 'pyamqp://guest:guest@10.0.0.33:5673//', 'pyamqp://guest:guest@10.0.0.249:5673//'] 12/01/2025 05:22:53.483 7f44c2241e88 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 12/01/2025 05:22:53.483 7f44b989a2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:22:53.484 7f44b989a2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 12/01/2025 05:22:53.484 7f44b989a2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:22:53.484 7f44b989a2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:22:53.484 7f44b989a2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 12/01/2025 05:22:53.484 7f44b989a2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:22:53.489 7f44c2241e88 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 12/01/2025 05:22:53.489 7f44b989a828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:22:53.490 7f44b989a828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 12/01/2025 05:22:53.490 7f44b989a828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:22:53.503 7f44c2241e88 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 12/01/2025 05:22:53.504 7f44b98994e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:22:53.504 7f44b98994e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 12/01/2025 05:22:53.504 7f44b98994e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:22:53.508 7f44c2241e88 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 12/01/2025 05:22:53.509 7f44c8125978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:22:53.509 7f44c8125978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 12/01/2025 05:22:53.509 7f44c8125978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:22:53.517 7f44c2241e88 [contrail-device-manager] [DEBUG]: Removed remaining AMQP queue from previous run 12/01/2025 05:22:53.518 7f44c2241e88 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 12/01/2025 05:22:53.518 7f44c2241e88 [contrail-device-manager] [WARNING]: initializing cassandra cluster 12/01/2025 05:22:53.518 7f44c2241e88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 12/01/2025 05:22:53.518 7f44bf1ab6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting consumer greenlet 12/01/2025 05:22:53.519 7f44bf1ab6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 12/01/2025 05:22:53.519 7f44b989aac8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting publisher greenlet 12/01/2025 05:22:53.519 7f44b989aac8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Publisher connection 12/01/2025 05:22:53.519 7f44b9834828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:22:53.520 7f44b9834828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 12/01/2025 05:22:53.520 7f44b9834828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:22:53.522 7f44c2241e88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 12/01/2025 05:22:53.527 7f44b989aac8 [contrail-device-manager] [INFO]: KombuAmqpClient: Publisher connection established 12/01/2025 05:22:53.528 7f44bf1ab6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 12/01/2025 05:22:53.528 7f44bf1ab6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Waiting for consumer 12/01/2025 05:22:53.563 7f44c2241e88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 12/01/2025 05:22:53.566 7f44b9688588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:22:53.567 7f44b9688588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 12/01/2025 05:22:53.567 7f44b9688588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:22:53.583 7f44c2241e88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 12/01/2025 05:22:53.583 7f44b9667978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:22:53.584 7f44b9667978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 12/01/2025 05:22:53.584 7f44b9667978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:22:54.593 7f44c2241e88 [contrail-device-manager] [WARNING]: Waiting for keyspace config_db_uuid to be created 12/01/2025 05:22:55.606 7f44c2241e88 [contrail-device-manager] [WARNING]: Waiting for keyspace config_db_uuid to be created 12/01/2025 05:22:56.705 7f44c2241e88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 12/01/2025 05:22:56.736 7f44c2241e88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 12/01/2025 05:22:57.414 7f44b9609ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:22:57.416 7f44b9609ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:22:57.416 7f44b9609ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:22:57.416 7f44b9609ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:22:57.417 7f44b9609ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 12/01/2025 05:22:57.417 7f44b9609ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:22:57.417 7f44b9609ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:22:57.417 7f44b9609ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:22:57.417 7f44b9609ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:22:57.417 7f44b9609ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 12/01/2025 05:22:57.418 7f44b9609ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:22:57.418 7f44b9609ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:22:57.418 7f44b9609ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:22:57.418 7f44b9609ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:22:58.847 7f44c2241e88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 12/01/2025 05:23:00.759 7f44c2241e88 [contrail-device-manager] [WARNING]: table 'obj_uuid_table', created 12/01/2025 05:23:00.765 7f44c2241e88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 12/01/2025 05:23:01.417 7f44b9609048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:23:01.418 7f44b9609048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:23:01.418 7f44b9609048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:23:01.418 7f44b9609048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:23:01.419 7f44b9609048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 12/01/2025 05:23:01.419 7f44b9609048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:23:01.419 7f44b9609048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:23:01.419 7f44b9609048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:23:01.419 7f44b9609048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:01.419 7f44b9609048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 12/01/2025 05:23:01.419 7f44b9609048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:01.419 7f44b9609048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:01.419 7f44b9609048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:23:01.419 7f44b9609048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:02.854 7f44c2241e88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 12/01/2025 05:23:03.752 7f44c2241e88 [contrail-device-manager] [WARNING]: table 'obj_uuid_table' fixed with properties {'gc_grace_seconds': 864000} 12/01/2025 05:23:03.760 7f44c2241e88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 12/01/2025 05:23:05.421 7f44b9681390 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:23:05.422 7f44b9681390 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:23:05.423 7f44b9681390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:23:05.423 7f44b9681390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:23:05.423 7f44b9681390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 12/01/2025 05:23:05.423 7f44b9681390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:23:05.423 7f44b9681390 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:23:05.423 7f44b9681390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:23:05.424 7f44b9681390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:05.424 7f44b9681390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 12/01/2025 05:23:05.424 7f44b9681390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:05.424 7f44b9681390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:05.424 7f44b9681390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:23:05.424 7f44b9681390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:05.732 7f44c2241e88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 12/01/2025 05:23:06.702 7f44c2241e88 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table', created 12/01/2025 05:23:06.709 7f44c2241e88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 12/01/2025 05:23:07.791 7f44c2241e88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 12/01/2025 05:23:08.709 7f44c2241e88 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table' fixed with properties {'gc_grace_seconds': 864000} 12/01/2025 05:23:08.715 7f44c2241e88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 12/01/2025 05:23:09.423 7f44b9609828 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:23:09.424 7f44b9609828 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:23:09.425 7f44b9609828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:23:09.425 7f44b9609828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:23:09.425 7f44b9609828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 12/01/2025 05:23:09.425 7f44b9609828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:23:09.425 7f44b9609828 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:23:09.425 7f44b9609828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:23:09.425 7f44b9609828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:09.426 7f44b9609828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 12/01/2025 05:23:09.426 7f44b9609828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:09.426 7f44b9609828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:09.426 7f44b9609828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:23:09.426 7f44b9609828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:10.772 7f44c2241e88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 12/01/2025 05:23:11.723 7f44c2241e88 [contrail-device-manager] [WARNING]: table 'obj_shared_table', created 12/01/2025 05:23:11.733 7f44c2241e88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 12/01/2025 05:23:12.711 7f44c2241e88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 12/01/2025 05:23:13.426 7f44b9604cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:23:13.427 7f44b9604cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:23:13.427 7f44b9604cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:23:13.427 7f44b9604cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:23:13.427 7f44b9604cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 12/01/2025 05:23:13.428 7f44b9604cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:23:13.428 7f44b9604cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:23:13.428 7f44b9604cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:23:13.428 7f44b9604cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:13.428 7f44b9604cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 12/01/2025 05:23:13.428 7f44b9604cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:13.428 7f44b9604cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:13.429 7f44b9604cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:23:13.429 7f44b9604cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:14.782 7f44c2241e88 [contrail-device-manager] [WARNING]: table 'obj_shared_table' fixed with properties {'gc_grace_seconds': 864000} 12/01/2025 05:23:14.787 7f44c2241e88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 12/01/2025 05:23:14.788 7f44b95fcb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:14.788 7f44b95fcb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:23:14.788 7f44b95fcb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:14.805 7f44c2241e88 [contrail-device-manager] [ERROR]: Error in db walk read 'type' 12/01/2025 05:23:14.807 7f44b961ccc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:14.807 7f44b961ccc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Zookeeper:Zookeeper[] connection down >>, ] >> 12/01/2025 05:23:14.807 7f44b961ccc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:14.820 7f44b8db9b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:14.820 7f44b8db9b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:23:14.820 7f44b8db9b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:14.821 7f44c2241e88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_status_consumer.dummy 12/01/2025 05:23:14.821 7f44c2241e88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_request_consumer 12/01/2025 05:23:14.821 7f44bf1ab6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 12/01/2025 05:23:14.821 7f44c2241e88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4829-3. 12/01/2025 05:23:14.831 7f44bf1ab6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 12/01/2025 05:23:14.919 7f44bf1ab6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4829-3.'] 12/01/2025 05:23:14.941 7f44bf1ab6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 12/01/2025 05:23:14.947 7f44bf1ab6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 12/01/2025 05:23:14.980 7f44bf1ab6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4829-3.'] 12/01/2025 05:23:15.332 7f44c2241e88 [contrail-device-manager] [DEBUG]: Fetching all containers 12/01/2025 05:23:15.407 7f44c2241e88 [contrail-device-manager] [INFO]: Restarting dnsmasq docker: config_dnsmasq_1 12/01/2025 05:23:15.566 7f44c2241e88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4829-3..config_queue 12/01/2025 05:23:15.567 7f44c2241e88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4829-3..tftp_queue 12/01/2025 05:23:15.998 7f44bf1ab6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 12/01/2025 05:23:16.005 7f44bf1ab6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 12/01/2025 05:23:16.068 7f44c2241e88 [contrail-device-manager] [WARNING]: Process 140 prepared to run in Full mode... 12/01/2025 05:23:16.068 7f44c2241e88 [contrail-device-manager] [WARNING]: Elected master Device Manager node. Initializing... 12/01/2025 05:23:16.068 7f44c2241e88 [contrail-device-manager] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8096 12/01/2025 05:23:16.073 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add [config_updater.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/config_updater] to home page 12/01/2025 05:23:16.073 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_ConfigApiUpdateReq] 12/01/2025 05:23:16.075 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add [greenlets.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/greenlets] to home page 12/01/2025 05:23:16.075 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_GreenletObjectReq] 12/01/2025 05:23:16.076 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add [cpuinfo.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/nodeinfo/cpuinfo] to home page 12/01/2025 05:23:16.076 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CpuLoadInfoReq] 12/01/2025 05:23:16.081 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add [dm_introspect.xml:/usr/lib/python3.6/site-packages/device_manager/sandesh/dm_introspect] to home page 12/01/2025 05:23:16.081 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_RoutingInstanceList] 12/01/2025 05:23:16.081 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualNetworkList] 12/01/2025 05:23:16.081 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualMachineInterfaceList] 12/01/2025 05:23:16.081 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalInterfaceList] 12/01/2025 05:23:16.081 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalInterfaceList] 12/01/2025 05:23:16.081 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalRouterList] 12/01/2025 05:23:16.082 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_BgpRouterList] 12/01/2025 05:23:16.082 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalRouterList] 12/01/2025 05:23:16.082 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_InstanceIpList] 12/01/2025 05:23:16.082 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FloatingIpList] 12/01/2025 05:23:16.082 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PortTupleList] 12/01/2025 05:23:16.082 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FeatureFlagList] 12/01/2025 05:23:16.083 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add [sandesh_alarm.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_alarm] to home page 12/01/2025 05:23:16.083 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmCacheRequest] 12/01/2025 05:23:16.083 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmTypesRequest] 12/01/2025 05:23:16.084 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmAckRequest] 12/01/2025 05:23:16.084 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add [sandesh_ctrl.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_ctrl] to home page 12/01/2025 05:23:16.084 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlClientToServer] 12/01/2025 05:23:16.084 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlServerToClient] 12/01/2025 05:23:16.085 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add [sandesh_trace.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_trace] to home page 12/01/2025 05:23:16.085 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceRequest] 12/01/2025 05:23:16.085 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferListRequest] 12/01/2025 05:23:16.085 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceEnableDisableReq] 12/01/2025 05:23:16.085 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufStatusReq] 12/01/2025 05:23:16.085 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferEnableDisableReq] 12/01/2025 05:23:16.086 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add [sandesh_uve.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_uve] to home page 12/01/2025 05:23:16.086 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshMessageStatsReq] 12/01/2025 05:23:16.086 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsSet] 12/01/2025 05:23:16.086 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsStatus] 12/01/2025 05:23:16.087 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsSet] 12/01/2025 05:23:16.087 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsStatus] 12/01/2025 05:23:16.087 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsSet] 12/01/2025 05:23:16.087 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsReset] 12/01/2025 05:23:16.087 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsStatus] 12/01/2025 05:23:16.087 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueSet] 12/01/2025 05:23:16.088 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueStatus] 12/01/2025 05:23:16.088 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CollectorInfoRequest] 12/01/2025 05:23:16.088 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVEDSConfReq] 12/01/2025 05:23:16.088 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVECacheReq] 12/01/2025 05:23:16.088 7f44c2241e88 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVETypesReq] 12/01/2025 05:23:16.091 7f44c2241e88 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.ztp_queue 12/01/2025 05:23:16.105 7f44b8d4c630 [contrail-device-manager] [ERROR]: Cannot write http_port 8096 to /tmp/contrail-device-manager.1.http_port 12/01/2025 05:23:16.105 7f44b8d4c630 [contrail-device-manager] [ERROR]: Starting Introspect on HTTP Port 8096 12/01/2025 05:23:16.158 7f44b84e90f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:16.158 7f44b84e90f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Initializing description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 12/01/2025 05:23:16.158 7f44b84e90f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:16.169 7f44b841b630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:16.169 7f44b841b630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 12/01/2025 05:23:16.169 7f44b841b630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:16.307 7f44bf1ab6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4829-3.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4829-3..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4829-3..tftp_queue', 'device_manager_ztp.ztp_queue'] 12/01/2025 05:23:16.343 7f44bf1ab6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 12/01/2025 05:23:16.357 7f44bf1ab6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 12/01/2025 05:23:16.404 7f44bf1ab6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4829-3.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4829-3..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4829-3..tftp_queue', 'device_manager_ztp.ztp_queue'] 12/01/2025 05:23:17.428 7f44b842a2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:23:17.429 7f44b842a2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:23:17.430 7f44b842a2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:23:17.430 7f44b842a2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:23:17.430 7f44b842a2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 12/01/2025 05:23:17.430 7f44b842a2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:23:17.430 7f44b842a2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:23:17.430 7f44b842a2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:23:17.430 7f44b842a2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:17.431 7f44b842a2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 12/01/2025 05:23:17.431 7f44b842a2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:17.431 7f44b842a2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:17.431 7f44b842a2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:23:17.431 7f44b842a2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:21.430 7f44b835a828 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:23:21.432 7f44b835a828 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:23:21.433 7f44b835a828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:23:21.433 7f44b835a828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:23:21.433 7f44b835a828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 12/01/2025 05:23:21.433 7f44b835a828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:23:21.433 7f44b835a828 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:23:21.433 7f44b835a828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:23:21.433 7f44b835a828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:21.434 7f44b835a828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 12/01/2025 05:23:21.434 7f44b835a828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:21.434 7f44b835a828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:21.434 7f44b835a828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:23:21.434 7f44b835a828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:25.271 7f44b8425d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:25.272 7f44b8425d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:23:25.272 7f44b8425d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:25.433 7f44b8355198 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:23:25.435 7f44b8355198 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:23:25.435 7f44b8355198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:23:25.436 7f44b8355198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:23:25.436 7f44b8355198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 05:23:25.436 7f44b8355198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:23:25.436 7f44b8355198 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:23:25.436 7f44b8355198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:23:25.436 7f44b8355198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:25.437 7f44b8355198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:23:25.437 7f44b8355198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:25.437 7f44b8355198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:25.437 7f44b8355198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:23:25.437 7f44b8355198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:29.436 7f44b8355d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:23:29.438 7f44b8355d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:23:29.438 7f44b8355d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:23:29.438 7f44b8355d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:23:29.439 7f44b8355d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 05:23:29.439 7f44b8355d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:23:29.439 7f44b8355d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:23:29.439 7f44b8355d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:23:29.440 7f44b8355d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:29.440 7f44b8355d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:23:29.440 7f44b8355d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:29.440 7f44b8355d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:29.440 7f44b8355d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:23:29.440 7f44b8355d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:33.439 7f44b842ac18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:23:33.440 7f44b842ac18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:23:33.440 7f44b842ac18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:23:33.440 7f44b842ac18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:23:33.441 7f44b842ac18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 05:23:33.441 7f44b842ac18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:23:33.441 7f44b842ac18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:23:33.441 7f44b842ac18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:23:33.441 7f44b842ac18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:33.441 7f44b842ac18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:23:33.441 7f44b842ac18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:33.441 7f44b842ac18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:33.441 7f44b842ac18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:23:33.442 7f44b842ac18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:37.441 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:23:37.447 7f44bf327c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:23:37.448 7f44bf327c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:23:37.448 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:23:37.448 7f44bf327c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 05:23:37.448 7f44bf327c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:23:37.448 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:23:37.449 7f44bf327c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:23:37.449 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:37.449 7f44bf327c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:23:37.449 7f44bf327c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:37.449 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:37.449 7f44bf327c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:23:37.449 7f44bf327c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:41.448 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:23:41.450 7f44bf327c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:23:41.450 7f44bf327c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:23:41.450 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:23:41.450 7f44bf327c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 05:23:41.450 7f44bf327c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:23:41.450 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:23:41.451 7f44bf327c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:23:41.451 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:41.451 7f44bf327c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:23:41.451 7f44bf327c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:41.451 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:41.451 7f44bf327c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:23:41.451 7f44bf327c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:45.450 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:23:45.451 7f44bf327c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:23:45.451 7f44bf327c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:23:45.451 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:23:45.451 7f44bf327c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 05:23:45.452 7f44bf327c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:23:45.452 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:23:45.452 7f44bf327c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:23:45.452 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:45.452 7f44bf327c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:23:45.452 7f44bf327c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:45.452 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:45.452 7f44bf327c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:23:45.452 7f44bf327c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:49.452 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:23:49.454 7f44bf327c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:23:49.454 7f44bf327c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:23:49.454 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:23:49.454 7f44bf327c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 05:23:49.454 7f44bf327c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:23:49.454 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:23:49.454 7f44bf327c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:23:49.455 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:49.455 7f44bf327c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:23:49.455 7f44bf327c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:49.455 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:49.455 7f44bf327c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:23:49.455 7f44bf327c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:53.454 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:23:53.455 7f44bf327c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:23:53.455 7f44bf327c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:23:53.455 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:23:53.456 7f44bf327c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 05:23:53.456 7f44bf327c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:23:53.456 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:23:53.456 7f44bf327c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:23:53.456 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:53.456 7f44bf327c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:23:53.456 7f44bf327c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:53.456 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:53.457 7f44bf327c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:23:53.457 7f44bf327c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:57.457 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:23:57.458 7f44bf327c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:23:57.458 7f44bf327c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:23:57.459 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:23:57.459 7f44bf327c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 05:23:57.459 7f44bf327c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:23:57.459 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:23:57.459 7f44bf327c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:23:57.459 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:57.459 7f44bf327c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:23:57.460 7f44bf327c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:57.460 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:23:57.460 7f44bf327c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:23:57.460 7f44bf327c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:01.459 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:24:01.461 7f44bf327c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:24:01.461 7f44bf327c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:24:01.461 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:24:01.461 7f44bf327c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 05:24:01.462 7f44bf327c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:24:01.462 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:24:01.462 7f44bf327c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:24:01.462 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:01.462 7f44bf327c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:24:01.462 7f44bf327c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:01.462 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:01.462 7f44bf327c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:24:01.462 7f44bf327c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:05.462 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:24:05.464 7f44bf327c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:24:05.464 7f44bf327c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:24:05.464 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:24:05.465 7f44bf327c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 05:24:05.465 7f44bf327c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:24:05.465 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:24:05.465 7f44bf327c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:24:05.465 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:05.465 7f44bf327c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:24:05.465 7f44bf327c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:05.466 7f44bf327c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:05.466 7f44bf327c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:24:05.466 7f44bf327c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:09.466 7f44b8432240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:24:09.467 7f44b8432240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:24:09.467 7f44b8432240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:24:09.467 7f44b8432240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:24:09.468 7f44b8432240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 05:24:09.468 7f44b8432240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:24:09.468 7f44b8432240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:24:09.468 7f44b8432240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:24:09.468 7f44b8432240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:09.468 7f44b8432240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:24:09.468 7f44b8432240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:09.468 7f44b8432240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:09.468 7f44b8432240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:24:09.468 7f44b8432240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:13.469 7f44b8432240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:24:13.471 7f44b8432240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:24:13.471 7f44b8432240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:24:13.471 7f44b8432240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:24:13.472 7f44b8432240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 05:24:13.472 7f44b8432240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:24:13.472 7f44b8432240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:24:13.473 7f44b8432240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:24:13.473 7f44b8432240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:13.473 7f44b8432240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:24:13.473 7f44b8432240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:13.473 7f44b8432240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:13.473 7f44b8432240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:24:13.473 7f44b8432240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:17.471 7f44b8432240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:24:17.473 7f44b8432240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:24:17.473 7f44b8432240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:24:17.473 7f44b8432240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:24:17.473 7f44b8432240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 05:24:17.473 7f44b8432240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:24:17.473 7f44b8432240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:24:17.474 7f44b8432240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:24:17.474 7f44b8432240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:17.474 7f44b8432240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:24:17.474 7f44b8432240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:17.474 7f44b8432240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:17.474 7f44b8432240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:24:17.474 7f44b8432240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:21.474 7f44b8425828 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:24:21.475 7f44b8425828 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:24:21.475 7f44b8425828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:24:21.475 7f44b8425828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:24:21.476 7f44b8425828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 05:24:21.476 7f44b8425828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:24:21.476 7f44b8425828 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:24:21.476 7f44b8425828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:24:21.476 7f44b8425828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:21.476 7f44b8425828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:24:21.476 7f44b8425828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:21.476 7f44b8425828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:21.477 7f44b8425828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:24:21.477 7f44b8425828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:25.476 7f44b8355048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:24:25.477 7f44b8355048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:24:25.478 7f44b8355048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:24:25.478 7f44b8355048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:24:25.478 7f44b8355048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 05:24:25.478 7f44b8355048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:24:25.478 7f44b8355048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:24:25.478 7f44b8355048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:24:25.478 7f44b8355048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:25.479 7f44b8355048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:24:25.479 7f44b8355048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:25.479 7f44b8355048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:25.479 7f44b8355048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:24:25.479 7f44b8355048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:29.478 7f44b8355048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:24:29.479 7f44b8355048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:24:29.479 7f44b8355048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:24:29.479 7f44b8355048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:24:29.479 7f44b8355048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 05:24:29.479 7f44b8355048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:24:29.479 7f44b8355048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:24:29.480 7f44b8355048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:24:29.480 7f44b8355048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:29.480 7f44b8355048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:24:29.480 7f44b8355048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:29.480 7f44b8355048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:29.480 7f44b8355048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:24:29.481 7f44b8355048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:33.479 7f44b841b4e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:24:33.480 7f44b841b4e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:24:33.480 7f44b841b4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:24:33.480 7f44b841b4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:24:33.481 7f44b841b4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 05:24:33.481 7f44b841b4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:24:33.481 7f44b841b4e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:24:33.481 7f44b841b4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:24:33.481 7f44b841b4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:33.481 7f44b841b4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:24:33.481 7f44b841b4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:33.481 7f44b841b4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:33.481 7f44b841b4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:24:33.481 7f44b841b4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:37.480 7f44b841b198 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:24:37.482 7f44b841b198 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:24:37.482 7f44b841b198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:24:37.482 7f44b841b198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:24:37.482 7f44b841b198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 05:24:37.482 7f44b841b198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:24:37.482 7f44b841b198 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:24:37.483 7f44b841b198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:24:37.483 7f44b841b198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:37.483 7f44b841b198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:24:37.483 7f44b841b198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:37.483 7f44b841b198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:37.483 7f44b841b198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:24:37.483 7f44b841b198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:41.483 7f44bf3c4048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:24:41.484 7f44bf3c4048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:24:41.485 7f44bf3c4048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:24:41.485 7f44bf3c4048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:24:41.485 7f44bf3c4048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 05:24:41.485 7f44bf3c4048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:24:41.485 7f44bf3c4048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:24:41.485 7f44bf3c4048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:24:41.485 7f44bf3c4048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:41.486 7f44bf3c4048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:24:41.486 7f44bf3c4048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:41.486 7f44bf3c4048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:41.486 7f44bf3c4048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:24:41.486 7f44bf3c4048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:45.485 7f44b967d978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:24:45.486 7f44b967d978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:24:45.486 7f44b967d978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:24:45.487 7f44b967d978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:24:45.487 7f44b967d978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 05:24:45.487 7f44b967d978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:24:45.487 7f44b967d978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:24:45.487 7f44b967d978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:24:45.487 7f44b967d978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:45.488 7f44b967d978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:24:45.488 7f44b967d978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:45.488 7f44b967d978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:45.488 7f44b967d978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:24:45.488 7f44b967d978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:49.487 7f44b84256d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:24:49.489 7f44b84256d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:24:49.490 7f44b84256d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:24:49.490 7f44b84256d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:24:49.490 7f44b84256d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 05:24:49.490 7f44b84256d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:24:49.490 7f44b84256d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:24:49.491 7f44b84256d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:24:49.491 7f44b84256d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:49.491 7f44b84256d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:24:49.491 7f44b84256d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:49.491 7f44b84256d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:49.491 7f44b84256d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:24:49.491 7f44b84256d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:53.490 7f44b965ed68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:24:53.491 7f44b965ed68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:24:53.492 7f44b965ed68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:24:53.492 7f44b965ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:24:53.492 7f44b965ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 05:24:53.492 7f44b965ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:24:53.492 7f44b965ed68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:24:53.493 7f44b965ed68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:24:53.493 7f44b965ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:53.493 7f44b965ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:24:53.493 7f44b965ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:53.493 7f44b965ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:53.493 7f44b965ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:24:53.493 7f44b965ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:55.834 7f44c2241e88 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 12/01/2025 05:24:55.834 7f44c2241e88 [contrail-device-manager] [WARNING]: initializing cassandra cluster 12/01/2025 05:24:55.834 7f44c2241e88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 12/01/2025 05:24:55.834 7f44bde66eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:55.835 7f44bde66eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 12/01/2025 05:24:55.835 7f44bde66eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:55.836 7f44c2241e88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 12/01/2025 05:24:55.891 7f44c2241e88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 12/01/2025 05:24:55.892 7f44b845f588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:55.892 7f44b845f588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Initializing description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 12/01/2025 05:24:55.892 7f44b845f588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:55.907 7f44c2241e88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 12/01/2025 05:24:55.907 7f44b845f438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:55.907 7f44b845f438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 12/01/2025 05:24:55.907 7f44b845f438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:55.922 7f44c2241e88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 12/01/2025 05:24:56.812 7f44c2241e88 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace', created 12/01/2025 05:24:56.817 7f44c2241e88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 12/01/2025 05:24:56.823 7f44c2241e88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 12/01/2025 05:24:57.492 7f44b82d1438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:24:57.493 7f44b82d1438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:24:57.493 7f44b82d1438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:24:57.493 7f44b82d1438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:24:57.494 7f44b82d1438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 12/01/2025 05:24:57.494 7f44b82d1438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:24:57.494 7f44b82d1438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:24:57.494 7f44b82d1438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:24:57.494 7f44b82d1438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:57.494 7f44b82d1438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 12/01/2025 05:24:57.494 7f44b82d1438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:57.494 7f44b82d1438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:57.494 7f44b82d1438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:24:57.495 7f44b82d1438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:24:57.701 7f44c2241e88 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None} 12/01/2025 05:24:57.706 7f44c2241e88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 12/01/2025 05:24:57.706 7f44c2241e88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 12/01/2025 05:24:57.773 7f44c2241e88 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 12/01/2025 05:24:57.790 7f44c2241e88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 12/01/2025 05:24:58.826 7f44c2241e88 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table', created 12/01/2025 05:24:58.834 7f44c2241e88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 12/01/2025 05:24:58.849 7f44c2241e88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 12/01/2025 05:25:00.678 7f44c2241e88 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table' fixed with properties {'gc_grace_seconds': 864000} 12/01/2025 05:25:00.685 7f44c2241e88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 12/01/2025 05:25:00.708 7f44c2241e88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 12/01/2025 05:25:01.494 7f44b961ba20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:25:01.495 7f44b961ba20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:25:01.495 7f44b961ba20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:25:01.496 7f44b961ba20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:25:01.496 7f44b961ba20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 12/01/2025 05:25:01.496 7f44b961ba20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:25:01.496 7f44b961ba20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:25:01.496 7f44b961ba20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:25:01.496 7f44b961ba20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:01.496 7f44b961ba20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 12/01/2025 05:25:01.497 7f44b961ba20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:01.497 7f44b961ba20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:01.497 7f44b961ba20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:25:01.497 7f44b961ba20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:01.804 7f44c2241e88 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table', created 12/01/2025 05:25:01.809 7f44c2241e88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 12/01/2025 05:25:01.824 7f44c2241e88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 12/01/2025 05:25:02.773 7f44c2241e88 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table' fixed with properties {'gc_grace_seconds': 864000} 12/01/2025 05:25:02.779 7f44c2241e88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 12/01/2025 05:25:02.790 7f44c2241e88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 12/01/2025 05:25:04.777 7f44c2241e88 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table', created 12/01/2025 05:25:04.784 7f44c2241e88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 12/01/2025 05:25:04.799 7f44c2241e88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 12/01/2025 05:25:05.496 7f44b831ed68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:25:05.498 7f44b831ed68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:25:05.498 7f44b831ed68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:25:05.498 7f44b831ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:25:05.498 7f44b831ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 12/01/2025 05:25:05.498 7f44b831ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:25:05.498 7f44b831ed68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:25:05.499 7f44b831ed68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:25:05.499 7f44b831ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:05.499 7f44b831ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 12/01/2025 05:25:05.499 7f44b831ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:05.499 7f44b831ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:05.499 7f44b831ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:25:05.499 7f44b831ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:05.669 7f44c2241e88 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table' fixed with properties {'gc_grace_seconds': 864000} 12/01/2025 05:25:05.675 7f44c2241e88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 12/01/2025 05:25:05.682 7f44c2241e88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 12/01/2025 05:25:06.687 7f44c2241e88 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table', created 12/01/2025 05:25:06.693 7f44c2241e88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 12/01/2025 05:25:06.704 7f44c2241e88 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 12/01/2025 05:25:07.809 7f44c2241e88 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table' fixed with properties {'gc_grace_seconds': 864000} 12/01/2025 05:25:07.820 7f44c2241e88 [contrail-device-manager] [WARNING]: Zookeeper lock released. 12/01/2025 05:25:07.821 7f44b9609eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:07.821 7f44b9609eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:25:07.821 7f44b9609eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:07.932 7f44c2241e88 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.50:5673//', 'pyamqp://guest:guest@10.0.0.33:5673//', 'pyamqp://guest:guest@10.0.0.249:5673//'] 12/01/2025 05:25:07.933 7f44c2241e88 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 12/01/2025 05:25:07.933 7f44b830b978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:07.933 7f44b830b978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Initializing description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 12/01/2025 05:25:07.933 7f44b830b978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:07.934 7f44b830b978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:07.934 7f44b830b978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 12/01/2025 05:25:07.934 7f44b830b978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:07.943 7f44c2241e88 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 12/01/2025 05:25:07.944 7f44b830bac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:07.944 7f44b830bac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:25:07.944 7f44b830bac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:08.076 7f44c2241e88 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 12/01/2025 05:25:08.077 7f44b830bac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:08.077 7f44b830bac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 12/01/2025 05:25:08.078 7f44b830bac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:08.094 7f44c2241e88 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 12/01/2025 05:25:08.094 7f44b82298d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:08.095 7f44b82298d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:25:08.095 7f44b82298d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:08.097 7f44b8229828 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 12/01/2025 05:25:08.098 7f44b8315a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:08.098 7f44b8315a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 12/01/2025 05:25:08.098 7f44b8315a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:08.117 7f44b8229828 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 12/01/2025 05:25:08.117 7f44b8310588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:08.117 7f44b8310588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:25:08.117 7f44b8310588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:09.499 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:25:09.500 7f44b8310cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:25:09.501 7f44b8310cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:25:09.501 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:25:09.501 7f44b8310cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 05:25:09.501 7f44b8310cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:25:09.501 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:25:09.501 7f44b8310cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:25:09.501 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:09.502 7f44b8310cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:25:09.502 7f44b8310cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:09.502 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:09.502 7f44b8310cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:25:09.502 7f44b8310cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:13.501 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:25:13.503 7f44b8310cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:25:13.503 7f44b8310cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:25:13.503 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:25:13.503 7f44b8310cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 05:25:13.503 7f44b8310cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:25:13.503 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:25:13.504 7f44b8310cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:25:13.504 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:13.504 7f44b8310cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:25:13.504 7f44b8310cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:13.504 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:13.504 7f44b8310cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:25:13.504 7f44b8310cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:17.503 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:25:17.505 7f44b8310cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:25:17.505 7f44b8310cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:25:17.505 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:25:17.505 7f44b8310cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 05:25:17.505 7f44b8310cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:25:17.505 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:25:17.506 7f44b8310cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:25:17.506 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:17.506 7f44b8310cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:25:17.506 7f44b8310cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:17.506 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:17.506 7f44b8310cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:25:17.506 7f44b8310cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:21.506 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:25:21.507 7f44b8310cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:25:21.508 7f44b8310cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:25:21.508 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:25:21.508 7f44b8310cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 05:25:21.508 7f44b8310cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:25:21.508 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:25:21.508 7f44b8310cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:25:21.508 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:21.508 7f44b8310cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:25:21.509 7f44b8310cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:21.509 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:21.509 7f44b8310cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:25:21.509 7f44b8310cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:25.509 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:25:25.510 7f44b8310cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:25:25.510 7f44b8310cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:25:25.510 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:25:25.510 7f44b8310cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 05:25:25.510 7f44b8310cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:25:25.511 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:25:25.511 7f44b8310cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:25:25.511 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:25.511 7f44b8310cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:25:25.511 7f44b8310cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:25.511 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:25.511 7f44b8310cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:25:25.511 7f44b8310cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:29.511 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:25:29.513 7f44b8310cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:25:29.513 7f44b8310cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:25:29.513 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:25:29.513 7f44b8310cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 05:25:29.513 7f44b8310cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:25:29.513 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:25:29.514 7f44b8310cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:25:29.514 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:29.514 7f44b8310cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:25:29.514 7f44b8310cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:29.514 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:29.514 7f44b8310cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:25:29.514 7f44b8310cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:33.513 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:25:33.515 7f44b8310cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 12/01/2025 05:25:33.515 7f44b8310cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:25:33.515 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:25:33.515 7f44b8310cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 05:25:33.515 7f44b8310cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:25:33.515 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 12/01/2025 05:25:33.516 7f44b8310cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 12/01/2025 05:25:33.516 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:33.517 7f44b8310cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 12/01/2025 05:25:33.517 7f44b8310cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:33.517 7f44b8310cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:33.517 7f44b8310cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1764566573415136 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.50:8086, 10.0.0.33:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 12/01/2025 05:25:33.517 7f44b8310cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 12/01/2025 05:25:35.857 7f44b82298d0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4829-3.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.249', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4829-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4829-3.'], 'id_perms': {'created': '2025-12-01T05:25:35.843428', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-12-01T05:25:35.843428', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11494706540736196976, 'uuid_mslong': 13667746821928601171}}, 'parent_type': 'global-system-config', 'parent_uuid': '8aeb8f56-c740-46d3-9fdf-e3277b324902', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'bdad9751-d907-4653-9f85-66b27df0b170'}, 'oper': 'CREATE', 'request-id': 'req-6565ef23-bd9d-492b-9ce5-be2defc1ee28', 'type': 'analytics_node', 'uuid': 'bdad9751-d907-4653-9f85-66b27df0b170'} 12/01/2025 05:25:35.907 7f44b82298d0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4829-2.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.33', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4829-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4829-2.'], 'id_perms': {'created': '2025-12-01T05:25:35.894503', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-12-01T05:25:35.894503', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9405546812555485988, 'uuid_mslong': 1595653797411178289}}, 'parent_type': 'global-system-config', 'parent_uuid': '8aeb8f56-c740-46d3-9fdf-e3277b324902', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1624e6ac-b332-4731-8287-36fe48ad6324'}, 'oper': 'CREATE', 'request-id': 'req-14b9ec5d-9a99-4ddb-a273-d510e31ff161', 'type': 'analytics_node', 'uuid': '1624e6ac-b332-4731-8287-36fe48ad6324'} 12/01/2025 05:25:35.959 7f44b82298d0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4829-1.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.50', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4829-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4829-1.'], 'id_perms': {'created': '2025-12-01T05:25:35.943364', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-12-01T05:25:35.943364', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12226029795906724462, 'uuid_mslong': 11832141758136470629}}, 'parent_type': 'global-system-config', 'parent_uuid': '8aeb8f56-c740-46d3-9fdf-e3277b324902', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a434363d-59ca-4c65-a9ab-9552b65ca26e'}, 'oper': 'CREATE', 'request-id': 'req-eeddc189-e08e-4577-afb4-2b1c6fda828a', 'type': 'analytics_node', 'uuid': 'a434363d-59ca-4c65-a9ab-9552b65ca26e'} 12/01/2025 05:25:37.516 7f44ba541a20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 12/01/2025 05:25:37.518 7f44ba541a20 [contrail-device-manager] [INFO]: Session Event: TCP Connected 12/01/2025 05:25:37.518 7f44ba541a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 12/01/2025 05:25:37.518 7f44ba541a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:25:37.518 7f44ba541a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4829-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.50:5673, 10.0.0.33:5673, 10.0.0.249:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.50:9041, 10.0.0.33:9041, 10.0.0.249:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.50:2181, 10.0.0.33:2181, 10.0.0.249:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.50,10.0.0.33,10.0.0.249:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 12/01/2025 05:25:37.518 7f44ba541a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 12/01/2025 05:25:37.518 7f44ba541a20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnected] in state[Connect] 12/01/2025 05:25:37.519 7f44ba541a20 [contrail-device-manager] [DEBUG]: Send sandesh control message. uve type count # 19 12/01/2025 05:25:37.520 7f44ba541a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 12/01/2025 05:25:37.520 7f44ba541a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 12/01/2025 05:25:37.520 7f44ba541a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 12/01/2025 05:25:37.520 7f44b84b8a20 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 12/01/2025 05:25:37.521 7f44b84b8a20 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 12/01/2025 05:25:52.569 7f44b84b88d0 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001016 12/01/2025 05:25:52.569 7f44b84b88d0 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 12/01/2025 05:25:52.570 7f44b835a630 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 12/01/2025 05:25:52.570 7f44b835a630 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 0 12/01/2025 05:25:52.570 7f44b835a630 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 12/01/2025 05:25:52.570 7f44b835a630 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 12/01/2025 05:25:52.570 7f44b835a630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 12/01/2025 05:25:52.571 7f44b82cf588 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 12/01/2025 05:25:52.573 7f44b82cf588 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 12/01/2025 05:25:55.615 7f44b82298d0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4829-3.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.249', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4829-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4829-3.'], 'id_perms': {'created': '2025-12-01T05:25:55.599846', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-12-01T05:25:55.599846', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10465701543681156738, 'uuid_mslong': 7763118997492615246}}, 'parent_type': 'global-system-config', 'parent_uuid': '8aeb8f56-c740-46d3-9fdf-e3277b324902', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6bbc2398-f2a2-484e-913d-a41ab45f6682'}, 'oper': 'CREATE', 'request-id': 'req-d55172fc-82ca-4905-b328-cdbdadebef47', 'type': 'analytics_alarm_node', 'uuid': '6bbc2398-f2a2-484e-913d-a41ab45f6682'} 12/01/2025 05:25:56.079 7f44b82298d0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4829-2.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.33', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4829-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4829-2.'], 'id_perms': {'created': '2025-12-01T05:25:56.057417', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-12-01T05:25:56.057417', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9699582214765853898, 'uuid_mslong': 17983466494505733146}}, 'parent_type': 'global-system-config', 'parent_uuid': '8aeb8f56-c740-46d3-9fdf-e3277b324902', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f9921b7f-0b27-4c1a-869b-d6a23cd0bcca'}, 'oper': 'CREATE', 'request-id': 'req-084c44e2-eaf0-42c4-906c-492a41390576', 'type': 'analytics_alarm_node', 'uuid': 'f9921b7f-0b27-4c1a-869b-d6a23cd0bcca'} 12/01/2025 05:25:56.171 7f44b82298d0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4829-1.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.50', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4829-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4829-1.'], 'id_perms': {'created': '2025-12-01T05:25:56.158517', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-12-01T05:25:56.158517', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13511630509654547411, 'uuid_mslong': 3355230821314218136}}, 'parent_type': 'global-system-config', 'parent_uuid': '8aeb8f56-c740-46d3-9fdf-e3277b324902', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2e902ca7-bbe0-4898-bb82-f45c604a1bd3'}, 'oper': 'CREATE', 'request-id': 'req-6c1acee9-0410-4cc3-bc68-7a8686e7d8c1', 'type': 'analytics_alarm_node', 'uuid': '2e902ca7-bbe0-4898-bb82-f45c604a1bd3'} 12/01/2025 05:26:02.539 7f44b84b88d0 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001296 12/01/2025 05:26:02.540 7f44b84b88d0 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 12/01/2025 05:26:02.541 7f44b845f438 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 12/01/2025 05:26:02.541 7f44b845f438 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 2 12/01/2025 05:26:02.541 7f44b845f438 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 12/01/2025 05:26:02.541 7f44b845f438 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 12/01/2025 05:26:08.630 7f44b82298d0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4829-3.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.249', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4829-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4829-3.'], 'id_perms': {'created': '2025-12-01T05:26:08.613745', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-12-01T05:26:08.613745', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9453991406844071312, 'uuid_mslong': 9572193553941284810}}, 'parent_type': 'global-system-config', 'parent_uuid': '8aeb8f56-c740-46d3-9fdf-e3277b324902', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '84d74352-57f4-47ca-8333-53185a894d90'}, 'oper': 'CREATE', 'request-id': 'req-d86dd228-fdc8-407d-9650-a8a2bf86fe57', 'type': 'analytics_snmp_node', 'uuid': '84d74352-57f4-47ca-8333-53185a894d90'} 12/01/2025 05:26:09.259 7f44b82298d0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4829-2.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.33', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4829-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4829-2.'], 'id_perms': {'created': '2025-12-01T05:26:09.242472', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-12-01T05:26:09.242472', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9839608149121387448, 'uuid_mslong': 3733882031984625259}}, 'parent_type': 'global-system-config', 'parent_uuid': '8aeb8f56-c740-46d3-9fdf-e3277b324902', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '33d169ec-d5a8-466b-888d-4f7aa96b4bb8'}, 'oper': 'CREATE', 'request-id': 'req-c45cd1cd-c8b4-4a2d-a44c-e7f302545b95', 'type': 'analytics_snmp_node', 'uuid': '33d169ec-d5a8-466b-888d-4f7aa96b4bb8'} 12/01/2025 05:26:09.300 7f44b82298d0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4829-1.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.50', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4829-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4829-1.'], 'id_perms': {'created': '2025-12-01T05:26:09.286672', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-12-01T05:26:09.286672', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12909428226243461062, 'uuid_mslong': 266014193050142793}}, 'parent_type': 'global-system-config', 'parent_uuid': '8aeb8f56-c740-46d3-9fdf-e3277b324902', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '03b1127f-c9f7-4849-b327-80931ea47fc6'}, 'oper': 'CREATE', 'request-id': 'req-c9fd0f85-17c0-45e7-9c5a-44c425c52ddb', 'type': 'analytics_snmp_node', 'uuid': '03b1127f-c9f7-4849-b327-80931ea47fc6'} 12/01/2025 05:28:03.665 7f44b82298d0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-d963f634-1c98-4c9b-8a2c-3bf1a18a0cf7', 'type': 'global_system_config', 'uuid': '8aeb8f56-c740-46d3-9fdf-e3277b324902'} 12/01/2025 05:28:03.819 7f44b82298d0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4829-1'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-4829-1', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4829-1'], 'id_perms': {'created': '2025-12-01T05:28:03.806921', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-12-01T05:28:03.806921', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13143468081463161235, 'uuid_mslong': 14654733757676538596}}, 'parent_type': 'global-system-config', 'parent_uuid': '8aeb8f56-c740-46d3-9fdf-e3277b324902', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'cb6012b5-603c-4ae4-b666-fa95404bf193', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.193'}, 'oper': 'CREATE', 'request-id': 'req-fc49754e-ab17-41ee-b1a2-a8ff59526112', 'type': 'virtual_router', 'uuid': 'cb6012b5-603c-4ae4-b666-fa95404bf193'} 12/01/2025 05:28:04.185 7f44b82298d0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4829-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4829-1', 'vhost0'], 'id_perms': {'created': '2025-12-01T05:28:04.156545', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-12-01T05:28:04.156545', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12098376531379212766, 'uuid_mslong': 9145074571738499488}}, 'parent_type': 'virtual-router', 'parent_uuid': 'cb6012b5-603c-4ae4-b666-fa95404bf193', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7ee9d4de-ccee-49a0-a7e6-115af7c7d1de', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:7e:e9:d4:de:cc']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '1dbf8a8e-e1e4-405d-87d8-e1e0688bcbca'}]}, 'oper': 'CREATE', 'request-id': 'req-b405e6a9-98af-406b-99ef-220a42375abb', 'type': 'virtual_machine_interface', 'uuid': '7ee9d4de-ccee-49a0-a7e6-115af7c7d1de'} 12/01/2025 05:28:04.236 7f44b82298d0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4829-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-b405e6a9-98af-406b-99ef-220a42375abb', 'type': 'virtual_machine_interface', 'uuid': '7ee9d4de-ccee-49a0-a7e6-115af7c7d1de'} 12/01/2025 05:28:04.748 7f44b82298d0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-826b2b78-44e5-49e8-9162-94c69097e60c', 'type': 'access_control_list', 'uuid': '0e49689d-6ea1-4b3a-82e1-1b6ee69a83a4'} 12/01/2025 05:28:56.263 7f44b82298d0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-41d93c02-81f7-45d9-a533-df0254704ae8', 'type': 'global_system_config', 'uuid': '8aeb8f56-c740-46d3-9fdf-e3277b324902'} 12/01/2025 05:28:56.411 7f44b82298d0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4829-2.'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-4829-2.', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4829-2.'], 'id_perms': {'created': '2025-12-01T05:28:56.397910', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-12-01T05:28:56.397910', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12410737236524509477, 'uuid_mslong': 5196590694466145155}}, 'parent_type': 'global-system-config', 'parent_uuid': '8aeb8f56-c740-46d3-9fdf-e3277b324902', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '481dffb4-32c1-4b83-ac3b-cbc2ffc1a925', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.0.0.19'}, 'oper': 'CREATE', 'request-id': 'req-865e9ee4-9896-4ff4-8b56-506ed4845e11', 'type': 'virtual_router', 'uuid': '481dffb4-32c1-4b83-ac3b-cbc2ffc1a925'} 12/01/2025 05:28:56.795 7f44b82298d0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4829-2.', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4829-2.', 'vhost0'], 'id_perms': {'created': '2025-12-01T05:28:56.775056', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-12-01T05:28:56.775056', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11239615945296551668, 'uuid_mslong': 7016143279991965830}}, 'parent_type': 'virtual-router', 'parent_uuid': '481dffb4-32c1-4b83-ac3b-cbc2ffc1a925', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '615e5923-d92a-4886-9bfb-2326f7379ef4', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:61:5e:59:23:d9']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '1dbf8a8e-e1e4-405d-87d8-e1e0688bcbca'}]}, 'oper': 'CREATE', 'request-id': 'req-390d3c5b-2f08-458e-ae3b-9befefdba4e2', 'type': 'virtual_machine_interface', 'uuid': '615e5923-d92a-4886-9bfb-2326f7379ef4'} 12/01/2025 05:28:56.872 7f44b82298d0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4829-2.', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-390d3c5b-2f08-458e-ae3b-9befefdba4e2', 'type': 'virtual_machine_interface', 'uuid': '615e5923-d92a-4886-9bfb-2326f7379ef4'}