07/03/2025 00:46:12.399 7f9ac9b34ec8 [contrail-device-manager] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 07/03/2025 00:46:12.399 7f9ac9b34ec8 [contrail-device-manager] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 07/03/2025 00:46:12.399 7f9ac9b34ec8 [contrail-device-manager] [INFO]: SANDESH: Flow Logging: [None] -> [False] 07/03/2025 00:46:12.399 7f9ac12122e8 [contrail-device-manager] [INFO]: Processing event[EvStart] in state[none] 07/03/2025 00:46:12.402 7f9ac12122e8 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 07/03/2025 00:46:12.402 7f9ac12122e8 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 07/03/2025 00:46:12.403 7f9ac12122e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 07/03/2025 00:46:12.403 7f9ac12122e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:12.403 7f9ac12122e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 07/03/2025 00:46:12.403 7f9ac12122e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:12.403 7f9ac12122e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:12.403 7f9ac12122e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 start_time = 1751503572402727 collector_name = collector_ip = collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 07/03/2025 00:46:12.403 7f9ac12122e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:12.477 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.41:5673//', 'pyamqp://guest:guest@10.0.0.27:5673//', 'pyamqp://guest:guest@10.0.0.23:5673//'] 07/03/2025 00:46:12.489 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 07/03/2025 00:46:12.490 7f9ac1167588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:12.490 7f9ac1167588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 07/03/2025 00:46:12.490 7f9ac1167588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:12.491 7f9ac1167588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:12.491 7f9ac1167588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 07/03/2025 00:46:12.491 7f9ac1167588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:16.402 7f9ac1182c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:16.404 7f9ac1182c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:16.404 7f9ac1182c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:16.404 7f9ac1182c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:16.404 7f9ac1182c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 07/03/2025 00:46:16.404 7f9ac1182c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:16.404 7f9ac1182c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:16.404 7f9ac1182c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:16.405 7f9ac1182c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:16.405 7f9ac1182c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 07/03/2025 00:46:16.405 7f9ac1182c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:16.405 7f9ac1182c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:16.405 7f9ac1182c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:16.405 7f9ac1182c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:18.507 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 07/03/2025 00:46:18.508 7f9ac100e4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:18.508 7f9ac100e4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:18.508 7f9ac100e4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:18.520 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 07/03/2025 00:46:18.520 7f9ac1167438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:18.521 7f9ac1167438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 07/03/2025 00:46:18.521 7f9ac1167438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:18.524 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 07/03/2025 00:46:18.524 7f9ac1182ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:18.524 7f9ac1182ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:18.524 7f9ac1182ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:18.531 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Removed remaining AMQP queue from previous run 07/03/2025 00:46:18.532 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 07/03/2025 00:46:18.532 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: initializing cassandra cluster 07/03/2025 00:46:18.533 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 07/03/2025 00:46:18.533 7f9ac9b4f8d0 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting consumer greenlet 07/03/2025 00:46:18.533 7f9ac9b4f8d0 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 07/03/2025 00:46:18.533 7f9ac1167b70 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting publisher greenlet 07/03/2025 00:46:18.534 7f9ac1167b70 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Publisher connection 07/03/2025 00:46:18.534 7f9ac100e240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:18.534 7f9ac100e240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 07/03/2025 00:46:18.534 7f9ac100e240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:18.538 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 07/03/2025 00:46:18.540 7f9ac1167b70 [contrail-device-manager] [INFO]: KombuAmqpClient: Publisher connection established 07/03/2025 00:46:18.540 7f9ac9b4f8d0 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 07/03/2025 00:46:18.540 7f9ac9b4f8d0 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Waiting for consumer 07/03/2025 00:46:18.569 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 07/03/2025 00:46:18.572 7f9ac0fd56d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:18.573 7f9ac0fd56d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 07/03/2025 00:46:18.573 7f9ac0fd56d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:18.586 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 07/03/2025 00:46:18.587 7f9ac0fd5588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:18.587 7f9ac0fd5588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 07/03/2025 00:46:18.587 7f9ac0fd5588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:18.600 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 07/03/2025 00:46:18.637 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 07/03/2025 00:46:19.730 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/03/2025 00:46:20.405 7f9ac3f30390 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:20.406 7f9ac3f30390 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:20.406 7f9ac3f30390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:20.406 7f9ac3f30390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:20.406 7f9ac3f30390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 07/03/2025 00:46:20.407 7f9ac3f30390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:20.407 7f9ac3f30390 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:20.407 7f9ac3f30390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:20.407 7f9ac3f30390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:20.407 7f9ac3f30390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 07/03/2025 00:46:20.407 7f9ac3f30390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:20.407 7f9ac3f30390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:20.408 7f9ac3f30390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:20.408 7f9ac3f30390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:20.701 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: table 'obj_shared_table', created 07/03/2025 00:46:20.709 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/03/2025 00:46:20.729 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/03/2025 00:46:21.664 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: table 'obj_shared_table' fixed with properties {'gc_grace_seconds': 864000} 07/03/2025 00:46:21.673 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/03/2025 00:46:21.674 7f9ac0ef6630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:21.674 7f9ac0ef6630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:21.674 7f9ac0ef6630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:21.701 7f9ac9b34ec8 [contrail-device-manager] [ERROR]: Error in db walk read 'type' 07/03/2025 00:46:21.702 7f9ac0f09780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:21.702 7f9ac0f09780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Zookeeper:Zookeeper[] connection down >>, ] >> 07/03/2025 00:46:21.703 7f9ac0f09780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:21.717 7f9ac0f05630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:21.717 7f9ac0f05630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:21.717 7f9ac0f05630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:21.718 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_status_consumer.dummy 07/03/2025 00:46:21.718 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_request_consumer 07/03/2025 00:46:21.718 7f9ac9b4f8d0 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 07/03/2025 00:46:21.719 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3591-1. 07/03/2025 00:46:21.724 7f9ac9b4f8d0 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 07/03/2025 00:46:21.742 7f9ac9b4f8d0 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3591-1.'] 07/03/2025 00:46:21.752 7f9ac9b4f8d0 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 07/03/2025 00:46:21.758 7f9ac9b4f8d0 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 07/03/2025 00:46:21.771 7f9ac9b4f8d0 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3591-1.'] 07/03/2025 00:46:22.263 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Fetching all containers 07/03/2025 00:46:22.537 7f9ac9b34ec8 [contrail-device-manager] [INFO]: Restarting dnsmasq docker: config_dnsmasq_1 07/03/2025 00:46:22.920 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3591-1..config_queue 07/03/2025 00:46:22.920 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3591-1..tftp_queue 07/03/2025 00:46:23.421 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: Process 136 prepared to run in Full mode... 07/03/2025 00:46:23.421 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: Elected master Device Manager node. Initializing... 07/03/2025 00:46:23.421 7f9ac9b34ec8 [contrail-device-manager] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8096 07/03/2025 00:46:23.430 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add [config_updater.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/config_updater] to home page 07/03/2025 00:46:23.430 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_ConfigApiUpdateReq] 07/03/2025 00:46:23.431 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add [greenlets.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/greenlets] to home page 07/03/2025 00:46:23.431 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_GreenletObjectReq] 07/03/2025 00:46:23.433 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add [cpuinfo.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/nodeinfo/cpuinfo] to home page 07/03/2025 00:46:23.433 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CpuLoadInfoReq] 07/03/2025 00:46:23.443 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add [dm_introspect.xml:/usr/lib/python3.6/site-packages/device_manager/sandesh/dm_introspect] to home page 07/03/2025 00:46:23.444 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_RoutingInstanceList] 07/03/2025 00:46:23.456 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualNetworkList] 07/03/2025 00:46:23.457 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualMachineInterfaceList] 07/03/2025 00:46:23.457 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalInterfaceList] 07/03/2025 00:46:23.457 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalInterfaceList] 07/03/2025 00:46:23.457 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalRouterList] 07/03/2025 00:46:23.457 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_BgpRouterList] 07/03/2025 00:46:23.457 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalRouterList] 07/03/2025 00:46:23.457 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_InstanceIpList] 07/03/2025 00:46:23.458 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FloatingIpList] 07/03/2025 00:46:23.458 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PortTupleList] 07/03/2025 00:46:23.458 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FeatureFlagList] 07/03/2025 00:46:23.471 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add [sandesh_alarm.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_alarm] to home page 07/03/2025 00:46:23.471 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmCacheRequest] 07/03/2025 00:46:23.471 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmTypesRequest] 07/03/2025 00:46:23.472 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmAckRequest] 07/03/2025 00:46:23.472 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add [sandesh_ctrl.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_ctrl] to home page 07/03/2025 00:46:23.472 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlClientToServer] 07/03/2025 00:46:23.472 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlServerToClient] 07/03/2025 00:46:23.473 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add [sandesh_trace.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_trace] to home page 07/03/2025 00:46:23.473 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceRequest] 07/03/2025 00:46:23.473 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferListRequest] 07/03/2025 00:46:23.473 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceEnableDisableReq] 07/03/2025 00:46:23.473 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufStatusReq] 07/03/2025 00:46:23.473 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferEnableDisableReq] 07/03/2025 00:46:23.484 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add [sandesh_uve.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_uve] to home page 07/03/2025 00:46:23.502 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshMessageStatsReq] 07/03/2025 00:46:23.502 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsSet] 07/03/2025 00:46:23.502 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsStatus] 07/03/2025 00:46:23.503 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsSet] 07/03/2025 00:46:23.503 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsStatus] 07/03/2025 00:46:23.503 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsSet] 07/03/2025 00:46:23.503 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsReset] 07/03/2025 00:46:23.503 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsStatus] 07/03/2025 00:46:23.503 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueSet] 07/03/2025 00:46:23.503 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueStatus] 07/03/2025 00:46:23.503 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CollectorInfoRequest] 07/03/2025 00:46:23.503 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVEDSConfReq] 07/03/2025 00:46:23.503 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVECacheReq] 07/03/2025 00:46:23.503 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVETypesReq] 07/03/2025 00:46:23.509 7f9ac9b34ec8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.ztp_queue 07/03/2025 00:46:23.545 7f9ac059ed68 [contrail-device-manager] [ERROR]: Cannot write http_port 8096 to /tmp/contrail-device-manager.1.http_port 07/03/2025 00:46:23.545 7f9ac059ed68 [contrail-device-manager] [ERROR]: Starting Introspect on HTTP Port 8096 07/03/2025 00:46:23.603 7f9abbe07780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:23.603 7f9abbe07780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Initializing description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 07/03/2025 00:46:23.603 7f9abbe07780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:23.624 7f9abbce6198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:23.624 7f9abbce6198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 07/03/2025 00:46:23.625 7f9abbce6198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:23.784 7f9ac9b4f8d0 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 07/03/2025 00:46:23.795 7f9ac9b4f8d0 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 07/03/2025 00:46:23.850 7f9ac9b4f8d0 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3591-1.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3591-1..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3591-1..tftp_queue', 'device_manager_ztp.ztp_queue'] 07/03/2025 00:46:24.407 7f9abbcdd4e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:24.409 7f9abbcdd4e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:24.409 7f9abbcdd4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:24.409 7f9abbcdd4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:24.410 7f9abbcdd4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 07/03/2025 00:46:24.410 7f9abbcdd4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:24.410 7f9abbcdd4e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:24.410 7f9abbcdd4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:24.411 7f9abbcdd4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:24.411 7f9abbcdd4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 07/03/2025 00:46:24.411 7f9abbcdd4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:24.411 7f9abbcdd4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:24.411 7f9abbcdd4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:24.411 7f9abbcdd4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:28.410 7f9abbc12438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:28.411 7f9abbc12438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:28.411 7f9abbc12438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:28.412 7f9abbc12438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:28.412 7f9abbc12438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 07/03/2025 00:46:28.412 7f9abbc12438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:28.413 7f9abbc12438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:28.414 7f9abbc12438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:28.414 7f9abbc12438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:28.415 7f9abbc12438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 07/03/2025 00:46:28.415 7f9abbc12438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:28.415 7f9abbc12438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:28.415 7f9abbc12438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:28.415 7f9abbc12438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:32.412 7f9abbbc2828 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:32.413 7f9abbbc2828 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:32.413 7f9abbbc2828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:32.413 7f9abbbc2828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:32.413 7f9abbbc2828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 07/03/2025 00:46:32.413 7f9abbbc2828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:32.413 7f9abbbc2828 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:32.413 7f9abbbc2828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:32.413 7f9abbbc2828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:32.414 7f9abbbc2828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 07/03/2025 00:46:32.414 7f9abbbc2828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:32.414 7f9abbbc2828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:32.414 7f9abbbc2828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:32.414 7f9abbbc2828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:32.901 7f9abbc124e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:32.902 7f9abbc124e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:32.902 7f9abbc124e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:36.414 7f9ac0f09780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:36.415 7f9ac0f09780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:36.415 7f9ac0f09780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:36.415 7f9ac0f09780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:36.416 7f9ac0f09780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:46:36.416 7f9ac0f09780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:36.416 7f9ac0f09780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:36.416 7f9ac0f09780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:36.416 7f9ac0f09780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:36.416 7f9ac0f09780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:36.416 7f9ac0f09780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:36.417 7f9ac0f09780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:36.417 7f9ac0f09780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:36.417 7f9ac0f09780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:40.416 7f9abbdb50f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:40.417 7f9abbdb50f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:40.417 7f9abbdb50f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:40.417 7f9abbdb50f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:40.417 7f9abbdb50f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:46:40.417 7f9abbdb50f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:40.417 7f9abbdb50f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:40.418 7f9abbdb50f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:40.418 7f9abbdb50f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:40.418 7f9abbdb50f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:40.418 7f9abbdb50f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:40.418 7f9abbdb50f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:40.418 7f9abbdb50f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:40.418 7f9abbdb50f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:44.418 7f9abbdaef60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:44.419 7f9abbdaef60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:44.419 7f9abbdaef60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:44.419 7f9abbdaef60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:44.419 7f9abbdaef60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:46:44.419 7f9abbdaef60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:44.420 7f9abbdaef60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:44.420 7f9abbdaef60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:44.420 7f9abbdaef60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:44.420 7f9abbdaef60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:44.420 7f9abbdaef60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:44.420 7f9abbdaef60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:44.421 7f9abbdaef60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:44.421 7f9abbdaef60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:48.420 7f9abbdae6d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:48.421 7f9abbdae6d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:48.421 7f9abbdae6d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:48.421 7f9abbdae6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:48.422 7f9abbdae6d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:46:48.422 7f9abbdae6d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:48.422 7f9abbdae6d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:48.422 7f9abbdae6d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:48.422 7f9abbdae6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:48.422 7f9abbdae6d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:48.423 7f9abbdae6d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:48.423 7f9abbdae6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:48.423 7f9abbdae6d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:48.423 7f9abbdae6d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:52.422 7f9abbdae6d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:52.423 7f9abbdae6d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:52.424 7f9abbdae6d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:52.424 7f9abbdae6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:52.424 7f9abbdae6d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:46:52.424 7f9abbdae6d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:52.424 7f9abbdae6d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:52.424 7f9abbdae6d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:52.424 7f9abbdae6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:52.425 7f9abbdae6d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:52.425 7f9abbdae6d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:52.425 7f9abbdae6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:52.425 7f9abbdae6d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:52.425 7f9abbdae6d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:56.425 7f9ac6c64438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:56.434 7f9ac6c64438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:56.434 7f9ac6c64438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:56.435 7f9ac6c64438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:56.435 7f9ac6c64438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:46:56.435 7f9ac6c64438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:56.435 7f9ac6c64438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:56.436 7f9ac6c64438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:56.436 7f9ac6c64438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:56.436 7f9ac6c64438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:56.437 7f9ac6c64438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:56.437 7f9ac6c64438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:56.437 7f9ac6c64438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:56.437 7f9ac6c64438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:00.442 7f9abbdae198 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:00.443 7f9abbdae198 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:00.444 7f9abbdae198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:00.444 7f9abbdae198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:00.444 7f9abbdae198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:00.444 7f9abbdae198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:00.444 7f9abbdae198 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:00.444 7f9abbdae198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:00.444 7f9abbdae198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:00.445 7f9abbdae198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:00.445 7f9abbdae198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:00.445 7f9abbdae198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:00.445 7f9abbdae198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:00.445 7f9abbdae198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:04.444 7f9abbdad4e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:04.445 7f9abbdad4e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:04.445 7f9abbdad4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:04.445 7f9abbdad4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:04.446 7f9abbdad4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:04.446 7f9abbdad4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:04.446 7f9abbdad4e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:04.446 7f9abbdad4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:04.446 7f9abbdad4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:04.446 7f9abbdad4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:04.446 7f9abbdad4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:04.447 7f9abbdad4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:04.447 7f9abbdad4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:04.447 7f9abbdad4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:08.446 7f9abbdad4e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:08.447 7f9abbdad4e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:08.448 7f9abbdad4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:08.448 7f9abbdad4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:08.448 7f9abbdad4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:08.448 7f9abbdad4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:08.448 7f9abbdad4e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:08.449 7f9abbdad4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:08.449 7f9abbdad4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:08.449 7f9abbdad4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:08.449 7f9abbdad4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:08.449 7f9abbdad4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:08.449 7f9abbdad4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:08.450 7f9abbdad4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:12.448 7f9abbda4f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:12.450 7f9abbda4f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:12.450 7f9abbda4f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:12.450 7f9abbda4f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:12.450 7f9abbda4f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:12.450 7f9abbda4f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:12.450 7f9abbda4f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:12.450 7f9abbda4f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:12.451 7f9abbda4f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:12.451 7f9abbda4f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:12.451 7f9abbda4f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:12.451 7f9abbda4f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:12.451 7f9abbda4f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:12.451 7f9abbda4f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:16.451 7f9abbdbd438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:16.454 7f9abbdbd438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:16.454 7f9abbdbd438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:16.454 7f9abbdbd438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:16.454 7f9abbdbd438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:16.454 7f9abbdbd438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:16.454 7f9abbdbd438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:16.455 7f9abbdbd438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:16.455 7f9abbdbd438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:16.455 7f9abbdbd438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:16.455 7f9abbdbd438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:16.455 7f9abbdbd438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:16.455 7f9abbdbd438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:16.455 7f9abbdbd438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:19.011 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 07/03/2025 00:47:19.011 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: initializing cassandra cluster 07/03/2025 00:47:19.011 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 07/03/2025 00:47:19.011 7f9ac7ea3d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:19.012 7f9ac7ea3d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 07/03/2025 00:47:19.012 7f9ac7ea3d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:19.013 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 07/03/2025 00:47:19.043 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 07/03/2025 00:47:19.045 7f9abbbe4a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:19.045 7f9abbbe4a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Initializing description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 07/03/2025 00:47:19.045 7f9abbbe4a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:19.053 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 07/03/2025 00:47:19.053 7f9abbbe4828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:19.054 7f9abbbe4828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 07/03/2025 00:47:19.054 7f9abbbe4828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:19.068 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/03/2025 00:47:19.552 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace', created 07/03/2025 00:47:19.564 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/03/2025 00:47:19.571 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/03/2025 00:47:20.454 7f9abbc12198 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:20.455 7f9abbc12198 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:20.455 7f9abbc12198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:20.455 7f9abbc12198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:20.456 7f9abbc12198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 07/03/2025 00:47:20.456 7f9abbc12198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:20.456 7f9abbc12198 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:20.456 7f9abbc12198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:20.456 7f9abbc12198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:20.456 7f9abbc12198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 07/03/2025 00:47:20.456 7f9abbc12198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:20.456 7f9abbc12198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:20.456 7f9abbc12198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:20.456 7f9abbc12198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:20.577 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None} 07/03/2025 00:47:20.583 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/03/2025 00:47:20.583 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 07/03/2025 00:47:20.672 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 07/03/2025 00:47:20.688 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/03/2025 00:47:21.653 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table', created 07/03/2025 00:47:21.661 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/03/2025 00:47:21.669 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/03/2025 00:47:23.414 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table' fixed with properties {'gc_grace_seconds': 864000} 07/03/2025 00:47:23.419 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/03/2025 00:47:23.427 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/03/2025 00:47:24.456 7f9abbacc048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:24.458 7f9abbacc048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:24.458 7f9abbacc048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:24.458 7f9abbacc048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:24.458 7f9abbacc048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 07/03/2025 00:47:24.458 7f9abbacc048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:24.458 7f9abbacc048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:24.459 7f9abbacc048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:24.459 7f9abbacc048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:24.459 7f9abbacc048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 07/03/2025 00:47:24.459 7f9abbacc048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:24.459 7f9abbacc048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:24.459 7f9abbacc048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:24.459 7f9abbacc048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:24.531 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table', created 07/03/2025 00:47:24.536 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/03/2025 00:47:24.544 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/03/2025 00:47:25.649 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table' fixed with properties {'gc_grace_seconds': 864000} 07/03/2025 00:47:25.655 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/03/2025 00:47:25.665 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/03/2025 00:47:27.253 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table', created 07/03/2025 00:47:27.259 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/03/2025 00:47:27.266 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/03/2025 00:47:28.366 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table' fixed with properties {'gc_grace_seconds': 864000} 07/03/2025 00:47:28.372 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/03/2025 00:47:28.379 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/03/2025 00:47:28.458 7f9abbc91240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:28.460 7f9abbc91240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:28.461 7f9abbc91240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:28.461 7f9abbc91240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:28.461 7f9abbc91240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 07/03/2025 00:47:28.461 7f9abbc91240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:28.462 7f9abbc91240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:28.462 7f9abbc91240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:28.463 7f9abbc91240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:28.463 7f9abbc91240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 07/03/2025 00:47:28.463 7f9abbc91240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:28.463 7f9abbc91240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:28.464 7f9abbc91240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:28.464 7f9abbc91240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:29.547 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table', created 07/03/2025 00:47:29.551 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/03/2025 00:47:29.560 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/03/2025 00:47:30.745 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table' fixed with properties {'gc_grace_seconds': 864000} 07/03/2025 00:47:30.750 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/03/2025 00:47:30.751 7f9abbca7588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:30.751 7f9abbca7588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:30.751 7f9abbca7588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:30.792 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.41:5673//', 'pyamqp://guest:guest@10.0.0.27:5673//', 'pyamqp://guest:guest@10.0.0.23:5673//'] 07/03/2025 00:47:30.793 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 07/03/2025 00:47:30.793 7f9abbad90f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:30.793 7f9abbad90f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Initializing description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 07/03/2025 00:47:30.793 7f9abbad90f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:30.793 7f9abbad90f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:30.793 7f9abbad90f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 07/03/2025 00:47:30.793 7f9abbad90f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:30.797 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 07/03/2025 00:47:30.797 7f9abbad9cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:30.797 7f9abbad9cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:30.797 7f9abbad9cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:30.870 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 07/03/2025 00:47:30.871 7f9abbae0e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:30.871 7f9abbae0e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 07/03/2025 00:47:30.871 7f9abbae0e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:30.874 7f9ac9b34ec8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 07/03/2025 00:47:30.875 7f9abbae04e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:30.875 7f9abbae04e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:30.875 7f9abbae04e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:30.876 7f9abbae08d0 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 07/03/2025 00:47:30.876 7f9abbaed588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:30.877 7f9abbaed588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 07/03/2025 00:47:30.877 7f9abbaed588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:30.881 7f9abbae08d0 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 07/03/2025 00:47:30.882 7f9abbad0cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:30.882 7f9abbad0cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:30.882 7f9abbad0cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:31.202 7f9abbae04e0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-8cc53da6-33a1-4c95-96f3-855b41c66ae1', 'type': 'global_system_config', 'uuid': '718cf37c-ec9e-419d-868e-644217cbd55b'} 07/03/2025 00:47:31.209 7f9abbae04e0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-22e80599-b3c4-40b4-a771-3f1ea71da427', 'type': 'global_system_config', 'uuid': '718cf37c-ec9e-419d-868e-644217cbd55b'} 07/03/2025 00:47:31.217 7f9abbae04e0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-5bda01a7-d5a9-4a01-854d-23721e0e105b', 'type': 'global_system_config', 'uuid': '718cf37c-ec9e-419d-868e-644217cbd55b'} 07/03/2025 00:47:32.461 7f9abbc0df60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:32.462 7f9abbc0df60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:32.462 7f9abbc0df60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:32.462 7f9abbc0df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:32.462 7f9abbc0df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:32.462 7f9abbc0df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:32.462 7f9abbc0df60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:32.463 7f9abbc0df60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:32.463 7f9abbc0df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:32.463 7f9abbc0df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:32.463 7f9abbc0df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:32.463 7f9abbc0df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:32.463 7f9abbc0df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:32.463 7f9abbc0df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:36.466 7f9abbc0df60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:36.475 7f9abbc0df60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:36.475 7f9abbc0df60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:36.475 7f9abbc0df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:36.475 7f9abbc0df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:36.475 7f9abbc0df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:36.475 7f9abbc0df60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:36.476 7f9abbc0df60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:36.476 7f9abbc0df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:36.476 7f9abbc0df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:36.476 7f9abbc0df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:36.476 7f9abbc0df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:36.476 7f9abbc0df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:36.476 7f9abbc0df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:40.476 7f9abbc0df60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:40.477 7f9abbc0df60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:40.477 7f9abbc0df60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:40.478 7f9abbc0df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:40.478 7f9abbc0df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:40.478 7f9abbc0df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:40.478 7f9abbc0df60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:40.478 7f9abbc0df60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:40.478 7f9abbc0df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:40.479 7f9abbc0df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:40.479 7f9abbc0df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:40.479 7f9abbc0df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:40.479 7f9abbc0df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:40.479 7f9abbc0df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:44.478 7f9abbc0df60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:44.479 7f9abbc0df60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:44.479 7f9abbc0df60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:44.479 7f9abbc0df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:44.479 7f9abbc0df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:44.479 7f9abbc0df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:44.480 7f9abbc0df60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:44.480 7f9abbc0df60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:44.480 7f9abbc0df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:44.480 7f9abbc0df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:44.480 7f9abbc0df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:44.480 7f9abbc0df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:44.480 7f9abbc0df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:44.480 7f9abbc0df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:48.480 7f9abbc0df60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:48.482 7f9abbc0df60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:48.482 7f9abbc0df60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:48.482 7f9abbc0df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:48.482 7f9abbc0df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:48.482 7f9abbc0df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:48.482 7f9abbc0df60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:48.483 7f9abbc0df60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:48.483 7f9abbc0df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:48.483 7f9abbc0df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:48.483 7f9abbc0df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:48.483 7f9abbc0df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:48.483 7f9abbc0df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:48.483 7f9abbc0df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:52.483 7f9ac0ee5e10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:52.484 7f9ac0ee5e10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:52.485 7f9ac0ee5e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:52.485 7f9ac0ee5e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:52.485 7f9ac0ee5e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:52.485 7f9ac0ee5e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:52.485 7f9ac0ee5e10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:52.485 7f9ac0ee5e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:52.486 7f9ac0ee5e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:52.486 7f9ac0ee5e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:52.486 7f9ac0ee5e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:52.486 7f9ac0ee5e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:52.486 7f9ac0ee5e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:52.486 7f9ac0ee5e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:56.486 7f9ac0ee5e10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:56.487 7f9ac0ee5e10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:56.487 7f9ac0ee5e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:56.487 7f9ac0ee5e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:56.487 7f9ac0ee5e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:56.487 7f9ac0ee5e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:56.487 7f9ac0ee5e10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:56.488 7f9ac0ee5e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:56.488 7f9ac0ee5e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:56.488 7f9ac0ee5e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:56.488 7f9ac0ee5e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:56.488 7f9ac0ee5e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:56.488 7f9ac0ee5e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:56.488 7f9ac0ee5e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:00.488 7f9ac0ee5e10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:48:00.490 7f9ac0ee5e10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:48:00.490 7f9ac0ee5e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:48:00.490 7f9ac0ee5e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:00.490 7f9ac0ee5e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:48:00.490 7f9ac0ee5e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:00.490 7f9ac0ee5e10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:48:00.490 7f9ac0ee5e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:48:00.490 7f9ac0ee5e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:00.491 7f9ac0ee5e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:48:00.491 7f9ac0ee5e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:00.491 7f9ac0ee5e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:00.491 7f9ac0ee5e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:48:00.491 7f9ac0ee5e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:04.185 7f9abbae04e0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3591-2.'], 'obj_dict': {'database_node_ip_address': '10.0.0.27', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3591-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3591-2.'], 'id_perms': {'created': '2025-07-03T00:48:04.177278', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-03T00:48:04.177278', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13324799075143036909, 'uuid_mslong': 18003171632469855191}}, 'parent_type': 'global-system-config', 'parent_uuid': '718cf37c-ec9e-419d-868e-644217cbd55b', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f9d81d36-ffc1-4bd7-b8eb-3229395aafed'}, 'oper': 'CREATE', 'request-id': 'req-c5ba2418-ef7e-4a36-9f82-febef6a48f3e', 'type': 'database_node', 'uuid': 'f9d81d36-ffc1-4bd7-b8eb-3229395aafed'} 07/03/2025 00:48:04.491 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:48:04.499 7f9abbdbd0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:48:04.499 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:48:04.499 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:04.499 7f9abbdbd0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:48:04.499 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:04.499 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:48:04.500 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:48:04.500 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:04.500 7f9abbdbd0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:48:04.500 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:04.500 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:04.500 7f9abbdbd0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:48:04.500 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:04.655 7f9abbae04e0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3591-3.'], 'obj_dict': {'database_node_ip_address': '10.0.0.23', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3591-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3591-3.'], 'id_perms': {'created': '2025-07-03T00:48:04.630817', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-03T00:48:04.630817', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9603304717829668752, 'uuid_mslong': 3575415798301738084}}, 'parent_type': 'global-system-config', 'parent_uuid': '718cf37c-ec9e-419d-868e-644217cbd55b', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '319e6db9-a618-4464-8545-cac2a811ff90'}, 'oper': 'CREATE', 'request-id': 'req-85f7b319-637b-417e-80b4-c609ca23a14f', 'type': 'database_node', 'uuid': '319e6db9-a618-4464-8545-cac2a811ff90'} 07/03/2025 00:48:04.753 7f9abbae04e0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3591-1.'], 'obj_dict': {'database_node_ip_address': '10.0.0.41', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3591-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3591-1.'], 'id_perms': {'created': '2025-07-03T00:48:04.736713', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-03T00:48:04.736713', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13441600563639735228, 'uuid_mslong': 8425218959799895337}}, 'parent_type': 'global-system-config', 'parent_uuid': '718cf37c-ec9e-419d-868e-644217cbd55b', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '74ec6401-55c2-4529-ba8a-287ef86fd3bc'}, 'oper': 'CREATE', 'request-id': 'req-1c3c9180-fa47-4097-84fb-93c03c7d65bd', 'type': 'database_node', 'uuid': '74ec6401-55c2-4529-ba8a-287ef86fd3bc'} 07/03/2025 00:48:08.499 7f9abbc9b828 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:48:08.500 7f9abbc9b828 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:48:08.500 7f9abbc9b828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:48:08.500 7f9abbc9b828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:08.501 7f9abbc9b828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:48:08.501 7f9abbc9b828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:08.501 7f9abbc9b828 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:48:08.501 7f9abbc9b828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:48:08.501 7f9abbc9b828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:08.501 7f9abbc9b828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:48:08.501 7f9abbc9b828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:08.501 7f9abbc9b828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:08.502 7f9abbc9b828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:48:08.502 7f9abbc9b828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:12.501 7f9abbc9b828 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:48:12.502 7f9abbc9b828 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:48:12.502 7f9abbc9b828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:48:12.502 7f9abbc9b828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:12.503 7f9abbc9b828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:48:12.503 7f9abbc9b828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:12.503 7f9abbc9b828 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:48:12.503 7f9abbc9b828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:48:12.503 7f9abbc9b828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:12.503 7f9abbc9b828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:48:12.503 7f9abbc9b828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:12.506 7f9abbc9b828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:12.506 7f9abbc9b828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:48:12.506 7f9abbc9b828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:16.503 7f9abbc9b828 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:48:16.505 7f9abbc9b828 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:48:16.505 7f9abbc9b828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:48:16.505 7f9abbc9b828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:16.505 7f9abbc9b828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:48:16.505 7f9abbc9b828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:16.505 7f9abbc9b828 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:48:16.506 7f9abbc9b828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:48:16.506 7f9abbc9b828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:16.506 7f9abbc9b828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:48:16.506 7f9abbc9b828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:16.506 7f9abbc9b828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:16.506 7f9abbc9b828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:48:16.506 7f9abbc9b828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:20.505 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:48:20.506 7f9abbdbd0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:48:20.506 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:48:20.506 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:20.507 7f9abbdbd0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:48:20.507 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:20.507 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:48:20.507 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:48:20.507 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:20.507 7f9abbdbd0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:48:20.507 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:20.507 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:20.508 7f9abbdbd0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:48:20.508 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:24.509 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:48:24.513 7f9abbdbd0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:48:24.514 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:48:24.514 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:24.514 7f9abbdbd0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:48:24.514 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:24.514 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:48:24.515 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:48:24.515 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:24.515 7f9abbdbd0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:48:24.515 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:24.515 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:24.515 7f9abbdbd0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:48:24.515 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:28.514 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:48:28.516 7f9abbdbd0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:48:28.517 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:48:28.517 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:28.517 7f9abbdbd0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:48:28.517 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:28.517 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:48:28.518 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:48:28.518 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:28.518 7f9abbdbd0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:48:28.518 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:28.518 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:28.518 7f9abbdbd0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:48:28.518 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:32.518 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:48:32.519 7f9abbdbd0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:48:32.519 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:48:32.519 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:32.519 7f9abbdbd0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:48:32.519 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:32.519 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:48:32.520 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:48:32.520 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:32.520 7f9abbdbd0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:48:32.520 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:32.520 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:32.520 7f9abbdbd0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1751503572402727 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.23:8086, 10.0.0.41:8086, 10.0.0.27:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:48:32.520 7f9abbdbd0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:35.200 7f9abbae04e0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3591-2.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.27', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3591-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3591-2.'], 'id_perms': {'created': '2025-07-03T00:48:35.188025', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-03T00:48:35.188025', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10529664053223303362, 'uuid_mslong': 475366117171282114}}, 'parent_type': 'global-system-config', 'parent_uuid': '718cf37c-ec9e-419d-868e-644217cbd55b', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '0698d6f7-0840-40c2-9220-e1aaf89328c2'}, 'oper': 'CREATE', 'request-id': 'req-3d5172be-12ff-46d5-adc6-b579c3b9d87b', 'type': 'analytics_node', 'uuid': '0698d6f7-0840-40c2-9220-e1aaf89328c2'} 07/03/2025 00:48:35.569 7f9abbae04e0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3591-3.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.23', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3591-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3591-3.'], 'id_perms': {'created': '2025-07-03T00:48:35.562305', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-03T00:48:35.562305', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9769008375014702549, 'uuid_mslong': 7403913702528470452}}, 'parent_type': 'global-system-config', 'parent_uuid': '718cf37c-ec9e-419d-868e-644217cbd55b', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '66bffc48-eadb-4db4-8792-7d5bd0913dd5'}, 'oper': 'CREATE', 'request-id': 'req-87da9db5-4607-4e17-b3cb-94cf56b624b4', 'type': 'analytics_node', 'uuid': '66bffc48-eadb-4db4-8792-7d5bd0913dd5'} 07/03/2025 00:48:35.644 7f9abbae04e0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3591-1.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.41', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3591-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3591-1.'], 'id_perms': {'created': '2025-07-03T00:48:35.636154', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-03T00:48:35.636154', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10893505639524708017, 'uuid_mslong': 9837776972993217898}}, 'parent_type': 'global-system-config', 'parent_uuid': '718cf37c-ec9e-419d-868e-644217cbd55b', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8886ce08-bec7-456a-972d-81a9b295aeb1'}, 'oper': 'CREATE', 'request-id': 'req-035af21c-54e4-426e-8c73-8bad9b5204b8', 'type': 'analytics_node', 'uuid': '8886ce08-bec7-456a-972d-81a9b295aeb1'} 07/03/2025 00:48:36.520 7f9ac6c80c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:48:36.521 7f9ac6c80c18 [contrail-device-manager] [INFO]: Session Event: TCP Connected 07/03/2025 00:48:36.521 7f9ac6c80c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:48:36.521 7f9ac6c80c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:36.521 7f9ac6c80c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:48:36.522 7f9ac6c80c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:36.523 7f9ac6c80c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnected] in state[Connect] 07/03/2025 00:48:36.523 7f9ac6c80c18 [contrail-device-manager] [DEBUG]: Send sandesh control message. uve type count # 19 07/03/2025 00:48:36.523 7f9ac6c80c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 07/03/2025 00:48:36.523 7f9ac6c80c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 07/03/2025 00:48:36.523 7f9ac6c80c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 07/03/2025 00:48:36.523 7f9abba7d780 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 07/03/2025 00:48:36.525 7f9abba7d780 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 07/03/2025 00:48:45.461 7f9abba7dcc0 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001016 07/03/2025 00:48:45.462 7f9abba7dcc0 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 07/03/2025 00:48:45.462 7f9ac1e2f6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 07/03/2025 00:48:45.462 7f9ac1e2f6d8 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 0 07/03/2025 00:48:45.462 7f9ac1e2f6d8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 07/03/2025 00:48:45.463 7f9ac1e2f6d8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 07/03/2025 00:48:45.463 7f9ac1e2f6d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 07/03/2025 00:48:45.463 7f9abba7ff60 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 07/03/2025 00:48:45.464 7f9abba7ff60 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 07/03/2025 00:48:53.467 7f9abbae04e0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3591-3.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.23', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3591-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3591-3.'], 'id_perms': {'created': '2025-07-03T00:48:53.441599', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-03T00:48:53.441599', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12709204397995343897, 'uuid_mslong': 4442057170946704734}}, 'parent_type': 'global-system-config', 'parent_uuid': '718cf37c-ec9e-419d-868e-644217cbd55b', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3da55b76-4241-455e-b060-2a1050584019'}, 'oper': 'CREATE', 'request-id': 'req-ac8f58c3-223c-49fa-8960-b583ab7fda6e', 'type': 'analytics_alarm_node', 'uuid': '3da55b76-4241-455e-b060-2a1050584019'} 07/03/2025 00:48:53.539 7f9abbae04e0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3591-2.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.27', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3591-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3591-2.'], 'id_perms': {'created': '2025-07-03T00:48:53.521827', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-03T00:48:53.521827', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12562791087986979572, 'uuid_mslong': 14982421836886003615}}, 'parent_type': 'global-system-config', 'parent_uuid': '718cf37c-ec9e-419d-868e-644217cbd55b', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'cfec4147-c6a5-4f9f-ae57-ffef1ae832f4'}, 'oper': 'CREATE', 'request-id': 'req-cb7bc1c7-de35-4916-af7c-603a8e02df84', 'type': 'analytics_alarm_node', 'uuid': 'cfec4147-c6a5-4f9f-ae57-ffef1ae832f4'} 07/03/2025 00:48:53.643 7f9abbae04e0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3591-1.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.41', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3591-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3591-1.'], 'id_perms': {'created': '2025-07-03T00:48:53.588792', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-03T00:48:53.588792', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11795502315168079193, 'uuid_mslong': 5285214657248644138}}, 'parent_type': 'global-system-config', 'parent_uuid': '718cf37c-ec9e-419d-868e-644217cbd55b', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4958daba-7efe-4c2a-a3b2-0adc42e41d59'}, 'oper': 'CREATE', 'request-id': 'req-a8b41840-7067-4aa3-9fed-f81e2bccc2fb', 'type': 'analytics_alarm_node', 'uuid': '4958daba-7efe-4c2a-a3b2-0adc42e41d59'} 07/03/2025 00:48:55.448 7f9abba7dcc0 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001296 07/03/2025 00:48:55.448 7f9abba7dcc0 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 07/03/2025 00:48:55.449 7f9abbda4cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 07/03/2025 00:48:55.449 7f9abbda4cc0 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 2 07/03/2025 00:48:55.449 7f9abbda4cc0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 07/03/2025 00:48:55.449 7f9abbda4cc0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 07/03/2025 00:49:03.693 7f9abbae04e0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3591-3.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.23', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3591-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3591-3.'], 'id_perms': {'created': '2025-07-03T00:49:03.675973', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-03T00:49:03.675973', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11936979602839353649, 'uuid_mslong': 5009307051694770538}}, 'parent_type': 'global-system-config', 'parent_uuid': '718cf37c-ec9e-419d-868e-644217cbd55b', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4584a239-1b20-496a-a5a8-abb43652b931'}, 'oper': 'CREATE', 'request-id': 'req-49567f91-7dd4-4b76-89e4-dff7567395b1', 'type': 'analytics_snmp_node', 'uuid': '4584a239-1b20-496a-a5a8-abb43652b931'} 07/03/2025 00:49:03.748 7f9abbae04e0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3591-1.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.41', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3591-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3591-1.'], 'id_perms': {'created': '2025-07-03T00:49:03.719316', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-03T00:49:03.719316', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13210022400903030389, 'uuid_mslong': 15585303897690751878}}, 'parent_type': 'global-system-config', 'parent_uuid': '718cf37c-ec9e-419d-868e-644217cbd55b', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd84a1f52-0a5e-4386-b753-6d6248c72675'}, 'oper': 'CREATE', 'request-id': 'req-64e086be-0373-42d4-b5bf-48ad7c16f08e', 'type': 'analytics_snmp_node', 'uuid': 'd84a1f52-0a5e-4386-b753-6d6248c72675'} 07/03/2025 00:49:03.777 7f9abbae04e0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3591-2.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.27', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3591-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3591-2.'], 'id_perms': {'created': '2025-07-03T00:49:03.745827', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-03T00:49:03.745827', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11744545579776520746, 'uuid_mslong': 17452272766328196229}}, 'parent_type': 'global-system-config', 'parent_uuid': '718cf37c-ec9e-419d-868e-644217cbd55b', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f232ed9d-6837-4c85-a2fd-01fac2f6b22a'}, 'oper': 'CREATE', 'request-id': 'req-82b53686-e692-46b2-9beb-956d7e1ada87', 'type': 'analytics_snmp_node', 'uuid': 'f232ed9d-6837-4c85-a2fd-01fac2f6b22a'} 07/03/2025 00:50:43.290 7f9abbae04e0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-21a2ec7b-1d02-4b97-9d0b-cd0d3548fe68', 'type': 'global_system_config', 'uuid': '718cf37c-ec9e-419d-868e-644217cbd55b'} 07/03/2025 00:50:43.375 7f9abbae04e0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-a3264baa-0e48-4557-bc88-4922ee731c82', 'type': 'global_system_config', 'uuid': '718cf37c-ec9e-419d-868e-644217cbd55b'} 07/03/2025 00:50:43.469 7f9abbae04e0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3591-1'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-3591-1', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3591-1'], 'id_perms': {'created': '2025-07-03T00:50:43.459117', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-03T00:50:43.459117', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11279940419727098863, 'uuid_mslong': 4346101699408118926}}, 'parent_type': 'global-system-config', 'parent_uuid': '718cf37c-ec9e-419d-868e-644217cbd55b', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3c507478-0ef1-448e-9c8a-660c4d6783ef', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.193'}, 'oper': 'CREATE', 'request-id': 'req-5b8e5126-3cd1-441b-a115-bd98298dfd4f', 'type': 'virtual_router', 'uuid': '3c507478-0ef1-448e-9c8a-660c4d6783ef'} 07/03/2025 00:50:43.515 7f9abbae04e0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3591-2'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-3591-2', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3591-2'], 'id_perms': {'created': '2025-07-03T00:50:43.505252', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-03T00:50:43.505252', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13271991397222165239, 'uuid_mslong': 6566137487375092672}}, 'parent_type': 'global-system-config', 'parent_uuid': '718cf37c-ec9e-419d-868e-644217cbd55b', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5b1f9b41-815e-4bc0-b82f-95db9577aaf7', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.129'}, 'oper': 'CREATE', 'request-id': 'req-78b5af13-bb66-4167-8b3f-9ae6e8460771', 'type': 'virtual_router', 'uuid': '5b1f9b41-815e-4bc0-b82f-95db9577aaf7'} 07/03/2025 00:50:43.841 7f9abbae04e0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3591-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3591-1', 'vhost0'], 'id_perms': {'created': '2025-07-03T00:50:43.813612', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-03T00:50:43.813612', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9537592086967416180, 'uuid_mslong': 13464080431506082510}}, 'parent_type': 'virtual-router', 'parent_uuid': '3c507478-0ef1-448e-9c8a-660c4d6783ef', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'bada05d1-1335-4ace-845c-55788444f574', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:ba:da:05:d1:13']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': 'a9957c65-3995-4084-a511-1461dd41a090'}]}, 'oper': 'CREATE', 'request-id': 'req-8e363331-e9ed-4225-818c-d38ec75cf77e', 'type': 'virtual_machine_interface', 'uuid': 'bada05d1-1335-4ace-845c-55788444f574'} 07/03/2025 00:50:43.891 7f9abbae04e0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3591-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-8e363331-e9ed-4225-818c-d38ec75cf77e', 'type': 'virtual_machine_interface', 'uuid': 'bada05d1-1335-4ace-845c-55788444f574'} 07/03/2025 00:50:43.931 7f9abbae04e0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3591-2', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3591-2', 'vhost0'], 'id_perms': {'created': '2025-07-03T00:50:43.903798', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-03T00:50:43.903798', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11204254888858832410, 'uuid_mslong': 13591306744739221387}}, 'parent_type': 'virtual-router', 'parent_uuid': '5b1f9b41-815e-4bc0-b82f-95db9577aaf7', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'bc9e0579-798d-4f8b-9b7d-82756f5d4e1a', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:bc:9e:05:79:79']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': 'a9957c65-3995-4084-a511-1461dd41a090'}]}, 'oper': 'CREATE', 'request-id': 'req-96d2708b-287f-4ee1-9d20-73277eccf911', 'type': 'virtual_machine_interface', 'uuid': 'bc9e0579-798d-4f8b-9b7d-82756f5d4e1a'} 07/03/2025 00:50:44.015 7f9abbae04e0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3591-2', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-96d2708b-287f-4ee1-9d20-73277eccf911', 'type': 'virtual_machine_interface', 'uuid': 'bc9e0579-798d-4f8b-9b7d-82756f5d4e1a'} 07/03/2025 00:50:44.402 7f9abbae04e0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-71866257-adb2-4d93-a1a0-3d8c6685402f', 'type': 'access_control_list', 'uuid': '63ed5ae8-d9c4-4617-bb1a-a7b50f745b1f'} 07/03/2025 01:08:27.724 7f9abbc9b828 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map