07/17/2025 00:41:43.791 7f6b41c8a348 [contrail-device-manager] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 07/17/2025 00:41:43.791 7f6b41c8a348 [contrail-device-manager] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 07/17/2025 00:41:43.791 7f6b41c8a348 [contrail-device-manager] [INFO]: SANDESH: Flow Logging: [None] -> [False] 07/17/2025 00:41:43.791 7f6b393712e8 [contrail-device-manager] [INFO]: Processing event[EvStart] in state[none] 07/17/2025 00:41:43.792 7f6b393712e8 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 07/17/2025 00:41:43.793 7f6b393712e8 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 07/17/2025 00:41:43.793 7f6b393712e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 07/17/2025 00:41:43.793 7f6b393712e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:43.793 7f6b393712e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 07/17/2025 00:41:43.794 7f6b393712e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:43.794 7f6b393712e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:43.794 7f6b393712e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 start_time = 1752712903793515 collector_name = collector_ip = collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 07/17/2025 00:41:43.794 7f6b393712e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:43.836 7f6b41c8a348 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.19:5673//', 'pyamqp://guest:guest@10.0.0.41:5673//', 'pyamqp://guest:guest@10.0.0.61:5673//'] 07/17/2025 00:41:43.844 7f6b41c8a348 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 07/17/2025 00:41:43.845 7f6b392c1588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:43.845 7f6b392c1588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 07/17/2025 00:41:43.845 7f6b392c1588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:43.845 7f6b392c1588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:43.845 7f6b392c1588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 07/17/2025 00:41:43.845 7f6b392c1588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:43.849 7f6b41c8a348 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 07/17/2025 00:41:43.849 7f6b392c1588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:43.850 7f6b392c1588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 07/17/2025 00:41:43.850 7f6b392c1588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:43.872 7f6b41c8a348 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 07/17/2025 00:41:43.872 7f6b392c1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:43.873 7f6b392c1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 07/17/2025 00:41:43.873 7f6b392c1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:43.877 7f6b41c8a348 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 07/17/2025 00:41:43.877 7f6b47b75978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:43.877 7f6b47b75978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 07/17/2025 00:41:43.877 7f6b47b75978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:43.917 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Removed remaining AMQP queue from previous run 07/17/2025 00:41:43.917 7f6b41c8a348 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 07/17/2025 00:41:43.917 7f6b41c8a348 [contrail-device-manager] [WARNING]: initializing cassandra cluster 07/17/2025 00:41:43.918 7f6b41c8a348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 07/17/2025 00:41:43.918 7f6b392ef6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting consumer greenlet 07/17/2025 00:41:43.918 7f6b392ef6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 07/17/2025 00:41:43.918 7f6b3bb0a978 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting publisher greenlet 07/17/2025 00:41:43.918 7f6b3bb0a978 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Publisher connection 07/17/2025 00:41:43.919 7f6b3915d588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:43.919 7f6b3915d588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 07/17/2025 00:41:43.919 7f6b3915d588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:43.920 7f6b41c8a348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 07/17/2025 00:41:43.923 7f6b3bb0a978 [contrail-device-manager] [INFO]: KombuAmqpClient: Publisher connection established 07/17/2025 00:41:43.923 7f6b392ef6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 07/17/2025 00:41:43.923 7f6b392ef6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Waiting for consumer 07/17/2025 00:41:44.154 7f6b41c8a348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 07/17/2025 00:41:44.155 7f6b390af978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:44.156 7f6b390af978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 07/17/2025 00:41:44.156 7f6b390af978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:44.174 7f6b41c8a348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 07/17/2025 00:41:44.174 7f6b3907c240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:44.175 7f6b3907c240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 07/17/2025 00:41:44.175 7f6b3907c240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:44.189 7f6b41c8a348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 07/17/2025 00:41:44.240 7f6b41c8a348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 07/17/2025 00:41:44.924 7f6b41c8a348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/17/2025 00:41:45.750 7f6b41c8a348 [contrail-device-manager] [WARNING]: table 'obj_uuid_table', created 07/17/2025 00:41:45.755 7f6b41c8a348 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/17/2025 00:41:47.793 7f6b39043438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:41:47.793 7f6b39043438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/17/2025 00:41:47.794 7f6b39043438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:41:47.794 7f6b39043438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:41:47.794 7f6b39043438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 07/17/2025 00:41:47.794 7f6b39043438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:41:47.794 7f6b39043438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/17/2025 00:41:47.794 7f6b39043438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/17/2025 00:41:47.794 7f6b39043438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:47.794 7f6b39043438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 07/17/2025 00:41:47.794 7f6b39043438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:47.794 7f6b39043438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:47.795 7f6b39043438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 start_time = 1752712903793515 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/17/2025 00:41:47.795 7f6b39043438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:47.944 7f6b41c8a348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/17/2025 00:41:48.778 7f6b41c8a348 [contrail-device-manager] [WARNING]: table 'obj_uuid_table' fixed with properties {'gc_grace_seconds': 864000} 07/17/2025 00:41:48.784 7f6b41c8a348 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/17/2025 00:41:51.795 7f6b39043c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:41:51.796 7f6b39043c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/17/2025 00:41:51.796 7f6b39043c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:41:51.796 7f6b39043c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:41:51.796 7f6b39043c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 07/17/2025 00:41:51.796 7f6b39043c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:41:51.796 7f6b39043c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/17/2025 00:41:51.797 7f6b39043c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/17/2025 00:41:51.797 7f6b39043c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:51.797 7f6b39043c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 07/17/2025 00:41:51.797 7f6b39043c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:51.797 7f6b39043c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:51.797 7f6b39043c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 start_time = 1752712903793515 collector_name = collector_ip = 10.0.0.61:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/17/2025 00:41:51.797 7f6b39043c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:51.810 7f6b41c8a348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/17/2025 00:41:52.781 7f6b41c8a348 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table', created 07/17/2025 00:41:52.788 7f6b41c8a348 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/17/2025 00:41:54.838 7f6b41c8a348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/17/2025 00:41:55.796 7f6b39046cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:41:55.798 7f6b39046cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/17/2025 00:41:55.798 7f6b39046cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:41:55.798 7f6b39046cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:41:55.798 7f6b39046cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 07/17/2025 00:41:55.798 7f6b39046cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:41:55.798 7f6b39046cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/17/2025 00:41:55.798 7f6b39046cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/17/2025 00:41:55.798 7f6b39046cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:55.799 7f6b39046cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 07/17/2025 00:41:55.799 7f6b39046cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:55.799 7f6b39046cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:55.799 7f6b39046cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 start_time = 1752712903793515 collector_name = collector_ip = 10.0.0.19:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/17/2025 00:41:55.799 7f6b39046cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:55.943 7f6b41c8a348 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table' fixed with properties {'gc_grace_seconds': 864000} 07/17/2025 00:41:55.950 7f6b41c8a348 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/17/2025 00:41:57.991 7f6b41c8a348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/17/2025 00:41:57.992 7f6b41c8a348 [contrail-device-manager] [WARNING]: table 'obj_shared_table', created 07/17/2025 00:41:57.999 7f6b41c8a348 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/17/2025 00:41:59.798 7f6b3e951048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:41:59.799 7f6b3e951048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/17/2025 00:41:59.799 7f6b3e951048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:41:59.799 7f6b3e951048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:41:59.799 7f6b3e951048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 07/17/2025 00:41:59.799 7f6b3e951048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:41:59.799 7f6b3e951048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/17/2025 00:41:59.799 7f6b3e951048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/17/2025 00:41:59.799 7f6b3e951048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:59.800 7f6b3e951048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 07/17/2025 00:41:59.800 7f6b3e951048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:59.800 7f6b3e951048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:59.800 7f6b3e951048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 start_time = 1752712903793515 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/17/2025 00:41:59.800 7f6b3e951048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:41:59.888 7f6b41c8a348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/17/2025 00:42:00.791 7f6b41c8a348 [contrail-device-manager] [WARNING]: table 'obj_shared_table' fixed with properties {'gc_grace_seconds': 864000} 07/17/2025 00:42:00.801 7f6b41c8a348 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/17/2025 00:42:00.801 7f6b3baf2ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:00.802 7f6b3baf2ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/17/2025 00:42:00.802 7f6b3baf2ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:00.832 7f6b41c8a348 [contrail-device-manager] [ERROR]: Error in db walk read 'type' 07/17/2025 00:42:00.834 7f6b39054c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:00.834 7f6b39054c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Zookeeper:Zookeeper[] connection down >>, ] >> 07/17/2025 00:42:00.834 7f6b39054c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:00.843 7f6b39050eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:00.843 7f6b39050eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/17/2025 00:42:00.843 7f6b39050eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:00.843 7f6b41c8a348 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_status_consumer.dummy 07/17/2025 00:42:00.843 7f6b41c8a348 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_request_consumer 07/17/2025 00:42:00.843 7f6b392ef6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 07/17/2025 00:42:00.844 7f6b41c8a348 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3647-2. 07/17/2025 00:42:00.848 7f6b392ef6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 07/17/2025 00:42:01.012 7f6b392ef6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3647-2.'] 07/17/2025 00:42:01.029 7f6b392ef6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 07/17/2025 00:42:01.034 7f6b392ef6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 07/17/2025 00:42:01.144 7f6b392ef6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3647-2.'] 07/17/2025 00:42:01.354 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Fetching all containers 07/17/2025 00:42:01.396 7f6b41c8a348 [contrail-device-manager] [INFO]: Restarting dnsmasq docker: config_dnsmasq_1 07/17/2025 00:42:01.561 7f6b41c8a348 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3647-2..config_queue 07/17/2025 00:42:01.561 7f6b41c8a348 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3647-2..tftp_queue 07/17/2025 00:42:02.062 7f6b41c8a348 [contrail-device-manager] [WARNING]: Process 138 prepared to run in Full mode... 07/17/2025 00:42:02.062 7f6b41c8a348 [contrail-device-manager] [WARNING]: Elected master Device Manager node. Initializing... 07/17/2025 00:42:02.062 7f6b41c8a348 [contrail-device-manager] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8096 07/17/2025 00:42:02.065 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add [config_updater.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/config_updater] to home page 07/17/2025 00:42:02.065 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_ConfigApiUpdateReq] 07/17/2025 00:42:02.066 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add [greenlets.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/greenlets] to home page 07/17/2025 00:42:02.066 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_GreenletObjectReq] 07/17/2025 00:42:02.068 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add [cpuinfo.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/nodeinfo/cpuinfo] to home page 07/17/2025 00:42:02.068 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CpuLoadInfoReq] 07/17/2025 00:42:02.073 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add [dm_introspect.xml:/usr/lib/python3.6/site-packages/device_manager/sandesh/dm_introspect] to home page 07/17/2025 00:42:02.073 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_RoutingInstanceList] 07/17/2025 00:42:02.073 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualNetworkList] 07/17/2025 00:42:02.073 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualMachineInterfaceList] 07/17/2025 00:42:02.073 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalInterfaceList] 07/17/2025 00:42:02.073 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalInterfaceList] 07/17/2025 00:42:02.073 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalRouterList] 07/17/2025 00:42:02.073 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_BgpRouterList] 07/17/2025 00:42:02.073 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalRouterList] 07/17/2025 00:42:02.073 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_InstanceIpList] 07/17/2025 00:42:02.074 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FloatingIpList] 07/17/2025 00:42:02.074 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PortTupleList] 07/17/2025 00:42:02.074 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FeatureFlagList] 07/17/2025 00:42:02.076 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add [sandesh_alarm.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_alarm] to home page 07/17/2025 00:42:02.076 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmCacheRequest] 07/17/2025 00:42:02.076 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmTypesRequest] 07/17/2025 00:42:02.077 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmAckRequest] 07/17/2025 00:42:02.077 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add [sandesh_ctrl.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_ctrl] to home page 07/17/2025 00:42:02.077 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlClientToServer] 07/17/2025 00:42:02.077 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlServerToClient] 07/17/2025 00:42:02.078 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add [sandesh_trace.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_trace] to home page 07/17/2025 00:42:02.078 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceRequest] 07/17/2025 00:42:02.078 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferListRequest] 07/17/2025 00:42:02.078 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceEnableDisableReq] 07/17/2025 00:42:02.078 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufStatusReq] 07/17/2025 00:42:02.078 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferEnableDisableReq] 07/17/2025 00:42:02.079 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add [sandesh_uve.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_uve] to home page 07/17/2025 00:42:02.079 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshMessageStatsReq] 07/17/2025 00:42:02.079 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsSet] 07/17/2025 00:42:02.079 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsStatus] 07/17/2025 00:42:02.079 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsSet] 07/17/2025 00:42:02.079 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsStatus] 07/17/2025 00:42:02.079 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsSet] 07/17/2025 00:42:02.079 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsReset] 07/17/2025 00:42:02.079 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsStatus] 07/17/2025 00:42:02.080 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueSet] 07/17/2025 00:42:02.080 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueStatus] 07/17/2025 00:42:02.080 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CollectorInfoRequest] 07/17/2025 00:42:02.080 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVEDSConfReq] 07/17/2025 00:42:02.080 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVECacheReq] 07/17/2025 00:42:02.080 7f6b41c8a348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVETypesReq] 07/17/2025 00:42:02.082 7f6b41c8a348 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.ztp_queue 07/17/2025 00:42:02.096 7f6b38715198 [contrail-device-manager] [ERROR]: Cannot write http_port 8096 to /tmp/contrail-device-manager.1.http_port 07/17/2025 00:42:02.096 7f6b38715198 [contrail-device-manager] [ERROR]: Starting Introspect on HTTP Port 8096 07/17/2025 00:42:02.138 7f6b33f1cac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:02.138 7f6b33f1cac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Initializing description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 07/17/2025 00:42:02.138 7f6b33f1cac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:02.147 7f6b39031cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:02.148 7f6b39031cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 07/17/2025 00:42:02.148 7f6b39031cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:02.162 7f6b392ef6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 07/17/2025 00:42:02.169 7f6b392ef6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 07/17/2025 00:42:02.329 7f6b392ef6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3647-2.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3647-2..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3647-2..tftp_queue', 'device_manager_ztp.ztp_queue'] 07/17/2025 00:42:03.800 7f6b33e7ae10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:42:03.802 7f6b33e7ae10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/17/2025 00:42:03.802 7f6b33e7ae10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:42:03.802 7f6b33e7ae10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:42:03.802 7f6b33e7ae10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 07/17/2025 00:42:03.802 7f6b33e7ae10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:42:03.802 7f6b33e7ae10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/17/2025 00:42:03.803 7f6b33e7ae10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/17/2025 00:42:03.803 7f6b33e7ae10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:03.803 7f6b33e7ae10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 07/17/2025 00:42:03.803 7f6b33e7ae10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:03.803 7f6b33e7ae10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:03.803 7f6b33e7ae10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1752712903793515 collector_name = collector_ip = 10.0.0.61:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/17/2025 00:42:03.803 7f6b33e7ae10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:07.802 7f6b33db90f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:42:07.804 7f6b33db90f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/17/2025 00:42:07.804 7f6b33db90f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:42:07.804 7f6b33db90f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:42:07.804 7f6b33db90f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 07/17/2025 00:42:07.804 7f6b33db90f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:42:07.804 7f6b33db90f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/17/2025 00:42:07.805 7f6b33db90f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/17/2025 00:42:07.805 7f6b33db90f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:07.805 7f6b33db90f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 07/17/2025 00:42:07.805 7f6b33db90f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:07.805 7f6b33db90f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:07.805 7f6b33db90f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1752712903793515 collector_name = collector_ip = 10.0.0.19:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/17/2025 00:42:07.805 7f6b33db90f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:08.274 7f6b33db5240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:08.274 7f6b33db5240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/17/2025 00:42:08.275 7f6b33db5240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:11.804 7f6b33d3da20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:42:11.805 7f6b33d3da20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/17/2025 00:42:11.805 7f6b33d3da20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:42:11.805 7f6b33d3da20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:42:11.806 7f6b33d3da20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/17/2025 00:42:11.806 7f6b33d3da20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:42:11.806 7f6b33d3da20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/17/2025 00:42:11.806 7f6b33d3da20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/17/2025 00:42:11.806 7f6b33d3da20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:11.806 7f6b33d3da20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/17/2025 00:42:11.806 7f6b33d3da20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:11.806 7f6b33d3da20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:11.806 7f6b33d3da20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1752712903793515 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/17/2025 00:42:11.807 7f6b33d3da20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:15.806 7f6b3907c828 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:42:15.807 7f6b3907c828 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/17/2025 00:42:15.807 7f6b3907c828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:42:15.807 7f6b3907c828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:42:15.808 7f6b3907c828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/17/2025 00:42:15.808 7f6b3907c828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:42:15.808 7f6b3907c828 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/17/2025 00:42:15.808 7f6b3907c828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/17/2025 00:42:15.808 7f6b3907c828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:15.808 7f6b3907c828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/17/2025 00:42:15.808 7f6b3907c828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:15.808 7f6b3907c828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:15.808 7f6b3907c828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1752712903793515 collector_name = collector_ip = 10.0.0.61:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/17/2025 00:42:15.808 7f6b3907c828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:19.808 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:42:19.809 7f6b33d24e10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/17/2025 00:42:19.810 7f6b33d24e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:42:19.810 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:42:19.810 7f6b33d24e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/17/2025 00:42:19.810 7f6b33d24e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:42:19.810 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/17/2025 00:42:19.810 7f6b33d24e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/17/2025 00:42:19.810 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:19.810 7f6b33d24e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/17/2025 00:42:19.810 7f6b33d24e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:19.810 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:19.810 7f6b33d24e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1752712903793515 collector_name = collector_ip = 10.0.0.19:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/17/2025 00:42:19.811 7f6b33d24e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:23.810 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:42:23.811 7f6b33d24e10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/17/2025 00:42:23.811 7f6b33d24e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:42:23.811 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:42:23.812 7f6b33d24e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/17/2025 00:42:23.812 7f6b33d24e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:42:23.812 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/17/2025 00:42:23.812 7f6b33d24e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/17/2025 00:42:23.812 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:23.812 7f6b33d24e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/17/2025 00:42:23.812 7f6b33d24e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:23.812 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:23.812 7f6b33d24e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1752712903793515 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/17/2025 00:42:23.812 7f6b33d24e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:27.812 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:42:27.813 7f6b33d24e10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/17/2025 00:42:27.813 7f6b33d24e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:42:27.813 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:42:27.814 7f6b33d24e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/17/2025 00:42:27.814 7f6b33d24e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:42:27.814 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/17/2025 00:42:27.814 7f6b33d24e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/17/2025 00:42:27.814 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:27.814 7f6b33d24e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/17/2025 00:42:27.814 7f6b33d24e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:27.814 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:27.814 7f6b33d24e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1752712903793515 collector_name = collector_ip = 10.0.0.61:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/17/2025 00:42:27.814 7f6b33d24e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:31.814 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:42:31.815 7f6b33d24e10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/17/2025 00:42:31.815 7f6b33d24e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:42:31.815 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:42:31.816 7f6b33d24e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/17/2025 00:42:31.816 7f6b33d24e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:42:31.816 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/17/2025 00:42:31.816 7f6b33d24e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/17/2025 00:42:31.816 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:31.816 7f6b33d24e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/17/2025 00:42:31.816 7f6b33d24e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:31.816 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:31.816 7f6b33d24e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1752712903793515 collector_name = collector_ip = 10.0.0.19:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/17/2025 00:42:31.816 7f6b33d24e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:35.816 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:42:35.817 7f6b33d24e10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/17/2025 00:42:35.817 7f6b33d24e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:42:35.817 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:42:35.817 7f6b33d24e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/17/2025 00:42:35.817 7f6b33d24e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:42:35.817 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/17/2025 00:42:35.818 7f6b33d24e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/17/2025 00:42:35.818 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:35.818 7f6b33d24e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/17/2025 00:42:35.818 7f6b33d24e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:35.818 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:35.818 7f6b33d24e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1752712903793515 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/17/2025 00:42:35.818 7f6b33d24e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:39.818 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:42:39.819 7f6b33d24e10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/17/2025 00:42:39.819 7f6b33d24e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:42:39.819 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:42:39.819 7f6b33d24e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/17/2025 00:42:39.820 7f6b33d24e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:42:39.820 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/17/2025 00:42:39.820 7f6b33d24e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/17/2025 00:42:39.820 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:39.820 7f6b33d24e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/17/2025 00:42:39.820 7f6b33d24e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:39.820 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:39.820 7f6b33d24e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1752712903793515 collector_name = collector_ip = 10.0.0.61:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/17/2025 00:42:39.820 7f6b33d24e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:43.820 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:42:43.821 7f6b33d24e10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/17/2025 00:42:43.821 7f6b33d24e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:42:43.821 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:42:43.822 7f6b33d24e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/17/2025 00:42:43.822 7f6b33d24e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:42:43.822 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/17/2025 00:42:43.822 7f6b33d24e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/17/2025 00:42:43.822 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:43.822 7f6b33d24e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/17/2025 00:42:43.822 7f6b33d24e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:43.822 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:43.822 7f6b33d24e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1752712903793515 collector_name = collector_ip = 10.0.0.19:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/17/2025 00:42:43.822 7f6b33d24e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:47.823 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:42:47.823 7f6b33d24e10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/17/2025 00:42:47.824 7f6b33d24e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:42:47.824 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:42:47.824 7f6b33d24e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/17/2025 00:42:47.824 7f6b33d24e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:42:47.824 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/17/2025 00:42:47.824 7f6b33d24e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/17/2025 00:42:47.824 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:47.824 7f6b33d24e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/17/2025 00:42:47.825 7f6b33d24e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:47.825 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:47.825 7f6b33d24e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1752712903793515 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/17/2025 00:42:47.825 7f6b33d24e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:51.824 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:42:51.825 7f6b33d24e10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/17/2025 00:42:51.826 7f6b33d24e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:42:51.826 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:42:51.826 7f6b33d24e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/17/2025 00:42:51.826 7f6b33d24e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:42:51.826 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/17/2025 00:42:51.826 7f6b33d24e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/17/2025 00:42:51.826 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:51.826 7f6b33d24e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/17/2025 00:42:51.826 7f6b33d24e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:51.827 7f6b33d24e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:51.827 7f6b33d24e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1752712903793515 collector_name = collector_ip = 10.0.0.61:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/17/2025 00:42:51.827 7f6b33d24e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:55.826 7f6b33d20b70 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:42:55.827 7f6b33d20b70 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/17/2025 00:42:55.827 7f6b33d20b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:42:55.827 7f6b33d20b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:42:55.827 7f6b33d20b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/17/2025 00:42:55.828 7f6b33d20b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:42:55.828 7f6b33d20b70 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/17/2025 00:42:55.828 7f6b33d20b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/17/2025 00:42:55.828 7f6b33d20b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:55.828 7f6b33d20b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/17/2025 00:42:55.828 7f6b33d20b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:55.828 7f6b33d20b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:55.828 7f6b33d20b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1752712903793515 collector_name = collector_ip = 10.0.0.19:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/17/2025 00:42:55.828 7f6b33d20b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:59.828 7f6b3f361a20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:42:59.829 7f6b3f361a20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/17/2025 00:42:59.829 7f6b3f361a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:42:59.829 7f6b3f361a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:42:59.829 7f6b3f361a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/17/2025 00:42:59.829 7f6b3f361a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:42:59.829 7f6b3f361a20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/17/2025 00:42:59.830 7f6b3f361a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/17/2025 00:42:59.830 7f6b3f361a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:59.830 7f6b3f361a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/17/2025 00:42:59.830 7f6b3f361a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:59.830 7f6b3f361a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:42:59.830 7f6b3f361a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1752712903793515 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/17/2025 00:42:59.830 7f6b3f361a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:03.829 7f6b3edc2630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:43:03.835 7f6b3edc2630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/17/2025 00:43:03.835 7f6b3edc2630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:43:03.835 7f6b3edc2630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:43:03.835 7f6b3edc2630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/17/2025 00:43:03.835 7f6b3edc2630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:43:03.835 7f6b3edc2630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/17/2025 00:43:03.836 7f6b3edc2630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/17/2025 00:43:03.836 7f6b3edc2630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:03.836 7f6b3edc2630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/17/2025 00:43:03.836 7f6b3edc2630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:03.836 7f6b3edc2630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:03.836 7f6b3edc2630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1752712903793515 collector_name = collector_ip = 10.0.0.61:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/17/2025 00:43:03.836 7f6b3edc2630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:07.836 7f6b392c1438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:43:07.837 7f6b392c1438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/17/2025 00:43:07.837 7f6b392c1438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:43:07.837 7f6b392c1438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:43:07.837 7f6b392c1438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/17/2025 00:43:07.837 7f6b392c1438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:43:07.837 7f6b392c1438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/17/2025 00:43:07.837 7f6b392c1438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/17/2025 00:43:07.837 7f6b392c1438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:07.838 7f6b392c1438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/17/2025 00:43:07.838 7f6b392c1438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:07.838 7f6b392c1438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:07.838 7f6b392c1438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1752712903793515 collector_name = collector_ip = 10.0.0.19:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/17/2025 00:43:07.838 7f6b392c1438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:11.837 7f6b33e7a4e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:43:11.838 7f6b33e7a4e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/17/2025 00:43:11.838 7f6b33e7a4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:43:11.838 7f6b33e7a4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:43:11.838 7f6b33e7a4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/17/2025 00:43:11.838 7f6b33e7a4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:43:11.838 7f6b33e7a4e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/17/2025 00:43:11.839 7f6b33e7a4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/17/2025 00:43:11.839 7f6b33e7a4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:11.839 7f6b33e7a4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/17/2025 00:43:11.839 7f6b33e7a4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:11.839 7f6b33e7a4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:11.839 7f6b33e7a4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1752712903793515 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/17/2025 00:43:11.839 7f6b33e7a4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:15.839 7f6b3907c978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:43:15.839 7f6b3907c978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/17/2025 00:43:15.840 7f6b3907c978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:43:15.840 7f6b3907c978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:43:15.840 7f6b3907c978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/17/2025 00:43:15.840 7f6b3907c978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:43:15.840 7f6b3907c978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/17/2025 00:43:15.840 7f6b3907c978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/17/2025 00:43:15.840 7f6b3907c978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:15.840 7f6b3907c978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/17/2025 00:43:15.841 7f6b3907c978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:15.841 7f6b3907c978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:15.841 7f6b3907c978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1752712903793515 collector_name = collector_ip = 10.0.0.61:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/17/2025 00:43:15.841 7f6b3907c978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:19.840 7f6b39097eb8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:43:19.841 7f6b39097eb8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/17/2025 00:43:19.841 7f6b39097eb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:43:19.841 7f6b39097eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:43:19.841 7f6b39097eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/17/2025 00:43:19.842 7f6b39097eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:43:19.842 7f6b39097eb8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/17/2025 00:43:19.842 7f6b39097eb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/17/2025 00:43:19.842 7f6b39097eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:19.842 7f6b39097eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/17/2025 00:43:19.842 7f6b39097eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:19.842 7f6b39097eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:19.842 7f6b39097eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1752712903793515 collector_name = collector_ip = 10.0.0.19:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/17/2025 00:43:19.842 7f6b39097eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:23.842 7f6b3ee46828 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:43:23.842 7f6b3ee46828 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/17/2025 00:43:23.843 7f6b3ee46828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:43:23.843 7f6b3ee46828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:43:23.843 7f6b3ee46828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/17/2025 00:43:23.843 7f6b3ee46828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:43:23.843 7f6b3ee46828 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/17/2025 00:43:23.843 7f6b3ee46828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/17/2025 00:43:23.843 7f6b3ee46828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:23.843 7f6b3ee46828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/17/2025 00:43:23.843 7f6b3ee46828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:23.843 7f6b3ee46828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:23.844 7f6b3ee46828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1752712903793515 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/17/2025 00:43:23.844 7f6b3ee46828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:25.196 7f6b41c8a348 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 07/17/2025 00:43:25.196 7f6b41c8a348 [contrail-device-manager] [WARNING]: initializing cassandra cluster 07/17/2025 00:43:25.196 7f6b41c8a348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 07/17/2025 00:43:25.196 7f6b40001d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:25.197 7f6b40001d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 07/17/2025 00:43:25.197 7f6b40001d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:25.197 7f6b41c8a348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 07/17/2025 00:43:25.248 7f6b41c8a348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 07/17/2025 00:43:25.250 7f6b33cefd68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:25.250 7f6b33cefd68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Initializing description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 07/17/2025 00:43:25.250 7f6b33cefd68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:25.259 7f6b41c8a348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 07/17/2025 00:43:25.259 7f6b33cefb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:25.259 7f6b33cefb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 07/17/2025 00:43:25.259 7f6b33cefb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:25.275 7f6b41c8a348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/17/2025 00:43:25.740 7f6b41c8a348 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace', created 07/17/2025 00:43:25.746 7f6b41c8a348 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/17/2025 00:43:25.752 7f6b41c8a348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/17/2025 00:43:26.871 7f6b41c8a348 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None} 07/17/2025 00:43:26.879 7f6b41c8a348 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/17/2025 00:43:26.879 7f6b41c8a348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 07/17/2025 00:43:26.947 7f6b41c8a348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 07/17/2025 00:43:26.954 7f6b41c8a348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/17/2025 00:43:27.843 7f6b33c7e4e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:43:27.844 7f6b33c7e4e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/17/2025 00:43:27.845 7f6b33c7e4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:43:27.845 7f6b33c7e4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:43:27.845 7f6b33c7e4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 07/17/2025 00:43:27.845 7f6b33c7e4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:43:27.845 7f6b33c7e4e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/17/2025 00:43:27.845 7f6b33c7e4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/17/2025 00:43:27.845 7f6b33c7e4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:27.845 7f6b33c7e4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 07/17/2025 00:43:27.846 7f6b33c7e4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:27.846 7f6b33c7e4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:27.846 7f6b33c7e4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1752712903793515 collector_name = collector_ip = 10.0.0.61:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/17/2025 00:43:27.846 7f6b33c7e4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:28.693 7f6b41c8a348 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table', created 07/17/2025 00:43:28.710 7f6b41c8a348 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/17/2025 00:43:28.721 7f6b41c8a348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/17/2025 00:43:29.026 7f6b41c8a348 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table' fixed with properties {'gc_grace_seconds': 864000} 07/17/2025 00:43:29.032 7f6b41c8a348 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/17/2025 00:43:29.057 7f6b41c8a348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/17/2025 00:43:29.886 7f6b41c8a348 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table', created 07/17/2025 00:43:29.893 7f6b41c8a348 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/17/2025 00:43:29.902 7f6b41c8a348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/17/2025 00:43:30.979 7f6b41c8a348 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table' fixed with properties {'gc_grace_seconds': 864000} 07/17/2025 00:43:30.984 7f6b41c8a348 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/17/2025 00:43:30.993 7f6b41c8a348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/17/2025 00:43:31.836 7f6b41c8a348 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table', created 07/17/2025 00:43:31.840 7f6b41c8a348 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/17/2025 00:43:31.845 7f6b33c048d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:43:31.846 7f6b33c048d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/17/2025 00:43:31.846 7f6b33c048d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:43:31.846 7f6b33c048d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:43:31.846 7f6b33c048d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 07/17/2025 00:43:31.846 7f6b33c048d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:43:31.846 7f6b33c048d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/17/2025 00:43:31.847 7f6b33c048d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/17/2025 00:43:31.847 7f6b33c048d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:31.847 7f6b33c048d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 07/17/2025 00:43:31.847 7f6b33c048d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:31.847 7f6b33c048d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:31.847 7f6b33c048d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1752712903793515 collector_name = collector_ip = 10.0.0.19:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/17/2025 00:43:31.847 7f6b33c048d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:31.848 7f6b41c8a348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/17/2025 00:43:32.955 7f6b41c8a348 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table' fixed with properties {'gc_grace_seconds': 864000} 07/17/2025 00:43:32.963 7f6b41c8a348 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/17/2025 00:43:32.985 7f6b41c8a348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/17/2025 00:43:33.925 7f6b41c8a348 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table', created 07/17/2025 00:43:33.929 7f6b41c8a348 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/17/2025 00:43:33.936 7f6b41c8a348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/17/2025 00:43:34.903 7f6b41c8a348 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table' fixed with properties {'gc_grace_seconds': 864000} 07/17/2025 00:43:34.911 7f6b41c8a348 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/17/2025 00:43:34.912 7f6b33c52c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:34.912 7f6b33c52c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/17/2025 00:43:34.912 7f6b33c52c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:34.968 7f6b41c8a348 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.19:5673//', 'pyamqp://guest:guest@10.0.0.41:5673//', 'pyamqp://guest:guest@10.0.0.61:5673//'] 07/17/2025 00:43:34.969 7f6b41c8a348 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 07/17/2025 00:43:34.969 7f6b33c97eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:34.970 7f6b33c97eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Initializing description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 07/17/2025 00:43:34.970 7f6b33c97eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:34.970 7f6b33c97eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:34.970 7f6b33c97eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 07/17/2025 00:43:34.970 7f6b33c97eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:34.979 7f6b41c8a348 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 07/17/2025 00:43:34.979 7f6b33c97eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:34.979 7f6b33c97eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/17/2025 00:43:34.979 7f6b33c97eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:35.035 7f6b41c8a348 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 07/17/2025 00:43:35.035 7f6b33c5ed68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:35.036 7f6b33c5ed68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 07/17/2025 00:43:35.036 7f6b33c5ed68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:35.049 7f6b41c8a348 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 07/17/2025 00:43:35.049 7f6b33ca00f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:35.050 7f6b33ca00f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/17/2025 00:43:35.050 7f6b33ca00f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:35.051 7f6b33c974e0 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 07/17/2025 00:43:35.051 7f6b33ce1048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:35.051 7f6b33ce1048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 07/17/2025 00:43:35.052 7f6b33ce1048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:35.066 7f6b33c974e0 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 07/17/2025 00:43:35.066 7f6b33c95240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:35.066 7f6b33c95240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/17/2025 00:43:35.066 7f6b33c95240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:35.847 7f6b33ceff60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:43:35.848 7f6b33ceff60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/17/2025 00:43:35.849 7f6b33ceff60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:43:35.849 7f6b33ceff60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:43:35.849 7f6b33ceff60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/17/2025 00:43:35.849 7f6b33ceff60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:43:35.849 7f6b33ceff60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/17/2025 00:43:35.849 7f6b33ceff60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/17/2025 00:43:35.849 7f6b33ceff60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:35.850 7f6b33ceff60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/17/2025 00:43:35.850 7f6b33ceff60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:35.850 7f6b33ceff60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:35.850 7f6b33ceff60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1752712903793515 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/17/2025 00:43:35.850 7f6b33ceff60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:39.850 7f6b33ceff60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:43:39.851 7f6b33ceff60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/17/2025 00:43:39.852 7f6b33ceff60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:43:39.852 7f6b33ceff60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:43:39.852 7f6b33ceff60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/17/2025 00:43:39.852 7f6b33ceff60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:43:39.852 7f6b33ceff60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/17/2025 00:43:39.852 7f6b33ceff60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/17/2025 00:43:39.853 7f6b33ceff60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:39.853 7f6b33ceff60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/17/2025 00:43:39.853 7f6b33ceff60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:39.853 7f6b33ceff60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:39.853 7f6b33ceff60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1752712903793515 collector_name = collector_ip = 10.0.0.61:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/17/2025 00:43:39.853 7f6b33ceff60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:43.852 7f6b33ceff60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:43:43.853 7f6b33ceff60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/17/2025 00:43:43.853 7f6b33ceff60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:43:43.854 7f6b33ceff60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:43:43.854 7f6b33ceff60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/17/2025 00:43:43.854 7f6b33ceff60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:43:43.854 7f6b33ceff60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/17/2025 00:43:43.854 7f6b33ceff60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/17/2025 00:43:43.854 7f6b33ceff60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:43.854 7f6b33ceff60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/17/2025 00:43:43.854 7f6b33ceff60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:43.854 7f6b33ceff60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:43.854 7f6b33ceff60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1752712903793515 collector_name = collector_ip = 10.0.0.19:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/17/2025 00:43:43.855 7f6b33ceff60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:47.855 7f6b33ceff60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:43:47.856 7f6b33ceff60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/17/2025 00:43:47.856 7f6b33ceff60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:43:47.856 7f6b33ceff60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:43:47.856 7f6b33ceff60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/17/2025 00:43:47.856 7f6b33ceff60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:43:47.856 7f6b33ceff60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/17/2025 00:43:47.856 7f6b33ceff60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/17/2025 00:43:47.856 7f6b33ceff60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:47.856 7f6b33ceff60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/17/2025 00:43:47.856 7f6b33ceff60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:47.857 7f6b33ceff60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:47.857 7f6b33ceff60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1752712903793515 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/17/2025 00:43:47.857 7f6b33ceff60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:51.856 7f6b33ceff60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:43:51.857 7f6b33ceff60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/17/2025 00:43:51.858 7f6b33ceff60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:43:51.858 7f6b33ceff60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:43:51.858 7f6b33ceff60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/17/2025 00:43:51.858 7f6b33ceff60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:43:51.858 7f6b33ceff60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/17/2025 00:43:51.858 7f6b33ceff60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/17/2025 00:43:51.858 7f6b33ceff60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:51.858 7f6b33ceff60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/17/2025 00:43:51.858 7f6b33ceff60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:51.859 7f6b33ceff60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:51.859 7f6b33ceff60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1752712903793515 collector_name = collector_ip = 10.0.0.61:8086 collector_list = [ 10.0.0.41:8086, 10.0.0.61:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/17/2025 00:43:51.859 7f6b33ceff60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/17/2025 00:43:54.791 7f6b33ca0978 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3647-2.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.41', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3647-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3647-2.'], 'id_perms': {'created': '2025-07-17T00:43:54.780135', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-17T00:43:54.780135', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12814750021726332103, 'uuid_mslong': 2016356827669483510}}, 'parent_type': 'global-system-config', 'parent_uuid': 'e36b5e0f-2b03-4c23-b1ee-f9135d480a32', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1bfb89da-05ac-4ff6-b1d7-233fd26d64c7'}, 'oper': 'CREATE', 'request-id': 'req-7a59c0b7-e8fa-4f16-a573-1f0c77f09ae4', 'type': 'analytics_node', 'uuid': '1bfb89da-05ac-4ff6-b1d7-233fd26d64c7'} 07/17/2025 00:43:55.155 7f6b33ca0978 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3647-3.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.61', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3647-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3647-3.'], 'id_perms': {'created': '2025-07-17T00:43:55.146956', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-17T00:43:55.146956', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11944445940784897885, 'uuid_mslong': 11331559598782826392}}, 'parent_type': 'global-system-config', 'parent_uuid': 'e36b5e0f-2b03-4c23-b1ee-f9135d480a32', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9d41c96a-fc9e-4798-a5c3-324c7b571f5d'}, 'oper': 'CREATE', 'request-id': 'req-d10fc318-1229-4eb9-a748-29c239d440c7', 'type': 'analytics_node', 'uuid': '9d41c96a-fc9e-4798-a5c3-324c7b571f5d'} 07/17/2025 00:43:55.221 7f6b33ca0978 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3647-1.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.19', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3647-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3647-1.'], 'id_perms': {'created': '2025-07-17T00:43:55.212087', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-17T00:43:55.212087', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10414629115157754651, 'uuid_mslong': 15879870188270534973}}, 'parent_type': 'global-system-config', 'parent_uuid': 'e36b5e0f-2b03-4c23-b1ee-f9135d480a32', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'dc60a1cd-132e-413d-9088-32004c6b331b'}, 'oper': 'CREATE', 'request-id': 'req-dbb5f322-aed5-4007-9438-7e42b34b4d80', 'type': 'analytics_node', 'uuid': 'dc60a1cd-132e-413d-9088-32004c6b331b'} 07/17/2025 00:43:55.859 7f6b33ba44e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/17/2025 00:43:55.860 7f6b33ba44e0 [contrail-device-manager] [INFO]: Session Event: TCP Connected 07/17/2025 00:43:55.860 7f6b33ba44e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/17/2025 00:43:55.860 7f6b33ba44e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:43:55.860 7f6b33ba44e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3647-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19,10.0.0.41,10.0.0.61:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/17/2025 00:43:55.860 7f6b33ba44e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/17/2025 00:43:55.860 7f6b33ba44e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnected] in state[Connect] 07/17/2025 00:43:55.861 7f6b33ba44e0 [contrail-device-manager] [DEBUG]: Send sandesh control message. uve type count # 19 07/17/2025 00:43:55.861 7f6b33ba44e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 07/17/2025 00:43:55.861 7f6b33ba44e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 07/17/2025 00:43:55.861 7f6b33ba44e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 07/17/2025 00:43:55.861 7f6b33ba66d8 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 07/17/2025 00:43:55.862 7f6b33ba66d8 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 07/17/2025 00:44:04.667 7f6b33ba6978 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001016 07/17/2025 00:44:04.668 7f6b33ba6978 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 07/17/2025 00:44:04.668 7f6b39f222e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 07/17/2025 00:44:04.668 7f6b39f222e8 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 0 07/17/2025 00:44:04.668 7f6b39f222e8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 07/17/2025 00:44:04.669 7f6b39f222e8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 07/17/2025 00:44:04.669 7f6b39f222e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 07/17/2025 00:44:04.669 7f6b33c95048 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 07/17/2025 00:44:04.670 7f6b33c95048 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 07/17/2025 00:44:09.706 7f6b33ca0978 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3647-1.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.19', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3647-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3647-1.'], 'id_perms': {'created': '2025-07-17T00:44:09.689284', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-17T00:44:09.689284', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11177821407578028331, 'uuid_mslong': 4452215061419413480}}, 'parent_type': 'global-system-config', 'parent_uuid': 'e36b5e0f-2b03-4c23-b1ee-f9135d480a32', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3dc97202-6f8c-4fe8-9b1f-9958f971f92b'}, 'oper': 'CREATE', 'request-id': 'req-6571a350-8fc5-4144-9f6e-3c2eccdf2424', 'type': 'analytics_alarm_node', 'uuid': '3dc97202-6f8c-4fe8-9b1f-9958f971f92b'} 07/17/2025 00:44:10.133 7f6b33ca0978 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3647-2.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.41', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3647-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3647-2.'], 'id_perms': {'created': '2025-07-17T00:44:10.122276', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-17T00:44:10.122276', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13090364180267712501, 'uuid_mslong': 11032822102818966835}}, 'parent_type': 'global-system-config', 'parent_uuid': 'e36b5e0f-2b03-4c23-b1ee-f9135d480a32', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '991c753f-849a-4d33-b5aa-50ddc15abff5'}, 'oper': 'CREATE', 'request-id': 'req-9829fd8e-5a24-44b6-a9cc-d90f2309babf', 'type': 'analytics_alarm_node', 'uuid': '991c753f-849a-4d33-b5aa-50ddc15abff5'} 07/17/2025 00:44:10.178 7f6b33ca0978 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3647-3.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.61', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3647-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3647-3.'], 'id_perms': {'created': '2025-07-17T00:44:10.170272', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-17T00:44:10.170272', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13821340048968799143, 'uuid_mslong': 15486040139403709155}}, 'parent_type': 'global-system-config', 'parent_uuid': 'e36b5e0f-2b03-4c23-b1ee-f9135d480a32', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd6e97775-4e99-4ae3-bfcf-438bc2aa53a7'}, 'oper': 'CREATE', 'request-id': 'req-cba0d4d8-8439-4147-a176-b7bc934e4780', 'type': 'analytics_alarm_node', 'uuid': 'd6e97775-4e99-4ae3-bfcf-438bc2aa53a7'} 07/17/2025 00:44:14.801 7f6b33ba6978 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001296 07/17/2025 00:44:14.802 7f6b33ba6978 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 07/17/2025 00:44:14.802 7f6b33c5b438 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 07/17/2025 00:44:14.802 7f6b33c5b438 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 2 07/17/2025 00:44:14.802 7f6b33c5b438 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 07/17/2025 00:44:14.802 7f6b33c5b438 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 07/17/2025 00:44:20.205 7f6b33ca0978 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3647-2.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.41', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3647-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3647-2.'], 'id_perms': {'created': '2025-07-17T00:44:20.195535', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-17T00:44:20.195535', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9317901597129278524, 'uuid_mslong': 12602995563997840688}}, 'parent_type': 'global-system-config', 'parent_uuid': 'e36b5e0f-2b03-4c23-b1ee-f9135d480a32', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'aee6d5b1-21ea-4530-814f-d6225cef843c'}, 'oper': 'CREATE', 'request-id': 'req-5cae7b08-4820-4d67-9626-66a6012419e4', 'type': 'analytics_snmp_node', 'uuid': 'aee6d5b1-21ea-4530-814f-d6225cef843c'} 07/17/2025 00:44:20.268 7f6b33ca0978 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3647-1.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.19', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3647-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3647-1.'], 'id_perms': {'created': '2025-07-17T00:44:20.262231', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-17T00:44:20.262231', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12857567761991280177, 'uuid_mslong': 14438446171310083095}}, 'parent_type': 'global-system-config', 'parent_uuid': 'e36b5e0f-2b03-4c23-b1ee-f9135d480a32', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c85faa4b-6d89-4c17-b26f-41c1d9012631'}, 'oper': 'CREATE', 'request-id': 'req-bcb091df-cc7c-4e7f-936e-aec4dcee81b7', 'type': 'analytics_snmp_node', 'uuid': 'c85faa4b-6d89-4c17-b26f-41c1d9012631'} 07/17/2025 00:44:20.281 7f6b33ca0978 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3647-3.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.61', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3647-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3647-3.'], 'id_perms': {'created': '2025-07-17T00:44:20.264342', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-17T00:44:20.264342', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10773210827142569475, 'uuid_mslong': 16983559946906124733}}, 'parent_type': 'global-system-config', 'parent_uuid': 'e36b5e0f-2b03-4c23-b1ee-f9135d480a32', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ebb1b9c9-f8e4-41bd-9582-222b1a399e03'}, 'oper': 'CREATE', 'request-id': 'req-d61a7154-2af2-47e3-9e11-e597665e4d2d', 'type': 'analytics_snmp_node', 'uuid': 'ebb1b9c9-f8e4-41bd-9582-222b1a399e03'} 07/17/2025 00:46:00.711 7f6b33ca0978 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-3d6face0-42e6-468f-b473-6b17cb444c65', 'type': 'global_system_config', 'uuid': 'e36b5e0f-2b03-4c23-b1ee-f9135d480a32'} 07/17/2025 00:46:00.769 7f6b33ca0978 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-2fc80cdf-7dc9-48b1-b657-77049a15dbdb', 'type': 'global_system_config', 'uuid': 'e36b5e0f-2b03-4c23-b1ee-f9135d480a32'} 07/17/2025 00:46:00.865 7f6b33ca0978 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3647-2'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-3647-2', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3647-2'], 'id_perms': {'created': '2025-07-17T00:46:00.852434', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-17T00:46:00.852434', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10009862090971336057, 'uuid_mslong': 2977609430160982064}}, 'parent_type': 'global-system-config', 'parent_uuid': 'e36b5e0f-2b03-4c23-b1ee-f9135d480a32', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '29529800-2c99-4030-8aea-2c8986fecd79', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.18'}, 'oper': 'CREATE', 'request-id': 'req-417ec8c1-db92-4f7b-b9d2-ed74b328b9bd', 'type': 'virtual_router', 'uuid': '29529800-2c99-4030-8aea-2c8986fecd79'} 07/17/2025 00:46:00.942 7f6b33ca0978 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3647-1'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-3647-1', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3647-1'], 'id_perms': {'created': '2025-07-17T00:46:00.930650', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-17T00:46:00.930650', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12808882933903836467, 'uuid_mslong': 17701308472801315392}}, 'parent_type': 'global-system-config', 'parent_uuid': 'e36b5e0f-2b03-4c23-b1ee-f9135d480a32', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f5a7ae45-3cef-4a40-b1c2-4b29fce6c533', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.129'}, 'oper': 'CREATE', 'request-id': 'req-d53f1351-f6ac-4143-b7d0-60e9de451175', 'type': 'virtual_router', 'uuid': 'f5a7ae45-3cef-4a40-b1c2-4b29fce6c533'} 07/17/2025 00:46:01.214 7f6b33ca0978 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3647-2', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3647-2', 'vhost0'], 'id_perms': {'created': '2025-07-17T00:46:01.195910', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-17T00:46:01.195910', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10662720385892715460, 'uuid_mslong': 8317598552970052695}}, 'parent_type': 'virtual-router', 'parent_uuid': '29529800-2c99-4030-8aea-2c8986fecd79', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '736e0bd0-be15-4457-93f9-97b28c738bc4', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:73:6e:0b:d0:be']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '55a235d9-b3cb-4c8e-8f9b-2dc85e91fc3b'}]}, 'oper': 'CREATE', 'request-id': 'req-bddbeb50-3434-4ecf-a349-f2056e8255a1', 'type': 'virtual_machine_interface', 'uuid': '736e0bd0-be15-4457-93f9-97b28c738bc4'} 07/17/2025 00:46:01.259 7f6b33ca0978 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3647-2', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-bddbeb50-3434-4ecf-a349-f2056e8255a1', 'type': 'virtual_machine_interface', 'uuid': '736e0bd0-be15-4457-93f9-97b28c738bc4'} 07/17/2025 00:46:01.300 7f6b33ca0978 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3647-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3647-1', 'vhost0'], 'id_perms': {'created': '2025-07-17T00:46:01.282654', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-17T00:46:01.282654', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12339798180911231145, 'uuid_mslong': 12570043448316872251}}, 'parent_type': 'virtual-router', 'parent_uuid': 'f5a7ae45-3cef-4a40-b1c2-4b29fce6c533', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ae71c3ea-d427-463b-ab3f-c5110539b0a9', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:ae:71:c3:ea:d4']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '55a235d9-b3cb-4c8e-8f9b-2dc85e91fc3b'}]}, 'oper': 'CREATE', 'request-id': 'req-cb42267e-f490-4a2d-8142-6909c2a30b73', 'type': 'virtual_machine_interface', 'uuid': 'ae71c3ea-d427-463b-ab3f-c5110539b0a9'} 07/17/2025 00:46:01.349 7f6b33ca0978 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3647-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-cb42267e-f490-4a2d-8142-6909c2a30b73', 'type': 'virtual_machine_interface', 'uuid': 'ae71c3ea-d427-463b-ab3f-c5110539b0a9'} 07/17/2025 00:46:01.757 7f6b33ca0978 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-f34fa8c4-9aff-4667-ae9a-346f728c6a3d', 'type': 'access_control_list', 'uuid': '9509d4fe-f748-4f95-8460-328650025d40'} 07/17/2025 00:46:33.570 7f6b3edddc18 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 07/17/2025 00:47:00.583 7f6b33c71588 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 07/17/2025 02:00:47.680 7f6b33ce0978 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map